Sep 08 00:00:40.053064 ip-10-0-135-226 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 08 00:00:40.053077 ip-10-0-135-226 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 08 00:00:40.053084 ip-10-0-135-226 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 08 00:00:40.053366 ip-10-0-135-226 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 08 00:00:50.262815 ip-10-0-135-226 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 08 00:00:50.262835 ip-10-0-135-226 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot bfdcf67030c94f3ab04bf8bdfb62b29b --
Sep 08 00:02:37.130806 ip-10-0-135-226 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 00:02:37.576974 ip-10-0-135-226 kubenswrapper[2580]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:37.576974 ip-10-0-135-226 kubenswrapper[2580]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 00:02:37.576974 ip-10-0-135-226 kubenswrapper[2580]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:37.576974 ip-10-0-135-226 kubenswrapper[2580]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 00:02:37.576974 ip-10-0-135-226 kubenswrapper[2580]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 00:02:37.577866 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.577073    2580 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 00:02:37.584257 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584230    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.584257 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584255    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.584257 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584259    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584265    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584270    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584273    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584276    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584279    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584282    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584285    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584288    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584290    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584294    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584296    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584299    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584301    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584314    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584316    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584319    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584322    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584324    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.584401 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584327    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584330    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584332    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584335    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584337    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584340    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584343    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584345    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584348    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584350    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584353    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584356    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584358    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584361    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584363    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584367    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584371    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584373    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584376    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584379    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.585081 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584381    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584384    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584387    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584390    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584392    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584396    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584398    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584401    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584416    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584419    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584421    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584424    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584427    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584429    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584432    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584434    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584437    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584440    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584442    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584446    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.585931 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584460    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584463    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584465    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584468    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584471    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584474    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584478    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584483    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584488    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584491    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584493    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584496    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584499    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584502    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584505    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584507    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584510    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584512    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584517    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584521    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.586708 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584524    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584533    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584535    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584538    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584541    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584543    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584546    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584549    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584553    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584556    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584559    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584562    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584565    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584568    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584571    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584574    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584577    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.587415 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.584579    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.588647 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588624    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.588647 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588644    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588650    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588655    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588659    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588662    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588665    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588669    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588671    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588675    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588680    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588683    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588687    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588689    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588692    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588695    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588697    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588700    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588703    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588706    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.588737 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588709    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588711    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588714    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588717    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588719    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588722    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588725    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588728    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588732    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588734    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588737    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588740    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588743    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588746    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588749    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588752    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588754    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588757    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588760    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588762    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.589422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588765    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588768    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588770    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588774    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588777    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588779    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588782    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588784    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588787    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588790    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588792    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588795    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588797    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588799    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588803    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588806    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588809    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588811    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588815    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588818    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.590169 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588820    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588823    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588826    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588828    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588831    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588834    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588836    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588839    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588842    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588845    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588847    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588852    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588854    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588857    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588860    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588862    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588865    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588867    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588870    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588872    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.590914 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588875    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588877    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588880    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588889    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588892    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588895    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588898    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588900    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588903    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588906    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588909    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588912    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588914    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588917    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588919    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588923    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588925    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588929    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.588932    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589385    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.591648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589392    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589395    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589398    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589401    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589404    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589406    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589409    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589411    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589414    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589417    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589419    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589422    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589426    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589428    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589431    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589440    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589443    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589446    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589465    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.592358 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589468    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589471    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589475    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589480    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589484    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589489    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589492    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589497    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589500    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589503    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589506    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589509    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589512    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589514    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589522    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589524    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589527    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589530    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589533    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.593060 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589536    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589538    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589541    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589544    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589547    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589550    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589553    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589555    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589558    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589560    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589571    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589574    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589576    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589579    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589582    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589584    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589587    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589590    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589592    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589595    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.593753 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589597    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589600    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589602    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589605    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589608    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589610    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589617    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589621    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589624    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589627    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589630    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589632    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589636    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589639    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589642    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589645    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589648    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589651    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589654    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589656    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.594534 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589659    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589662    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589664    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589673    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589675    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589678    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589680    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589683    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589686    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589688    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589691    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589694    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589696    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589699    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589701    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589703    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589706    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589708    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589711    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.589713    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.595235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589794    2580 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589840    2580 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589850    2580 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589858    2580 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589863    2580 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589866    2580 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589870    2580 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589875    2580 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589878    2580 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589881    2580 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589884    2580 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589888    2580 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589891    2580 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589894    2580 flags.go:64] FLAG: --cgroup-root=""
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589897    2580 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589900    2580 flags.go:64] FLAG: --client-ca-file=""
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589911    2580 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589915    2580 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589922    2580 flags.go:64] FLAG: --cluster-domain=""
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589925    2580 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589928    2580 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589931    2580 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589934    2580 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589938    2580 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 00:02:37.595987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589941    2580 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589944    2580 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589947    2580 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589950    2580 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589953    2580 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589956    2580 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589959    2580 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589962    2580 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589966    2580 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589969    2580 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589973    2580 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589975    2580 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589978    2580 flags.go:64] FLAG: --enable-server="true"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589981    2580 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589988    2580 flags.go:64] FLAG: --event-burst="100"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589992    2580 flags.go:64] FLAG: --event-qps="50"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589996    2580 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.589998    2580 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590001    2580 flags.go:64] FLAG: --eviction-hard=""
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590005    2580 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590008    2580 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590011    2580 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590014    2580 flags.go:64] FLAG: --eviction-soft=""
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590018    2580 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590023    2580 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 00:02:37.596844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590031    2580 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590034    2580 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590037    2580 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590040    2580 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590043    2580 flags.go:64] FLAG: --feature-gates=""
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590051    2580 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590054    2580 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590057    2580 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590060    2580 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590063    2580 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590066    2580 flags.go:64] FLAG: --help="false"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590069    2580 flags.go:64] FLAG: --hostname-override="ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590072    2580 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590075    2580 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590078    2580 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590081    2580 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590085    2580 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590088    2580 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590090    2580 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590093    2580 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590096    2580 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590099    2580 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590106    2580 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590108    2580 flags.go:64] FLAG: --kube-reserved=""
Sep 08 00:02:37.597756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590111    2580 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590114    2580 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590118    2580 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590121    2580 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590124    2580 flags.go:64] FLAG: --lock-file=""
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590126    2580 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590129    2580 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590134    2580 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590139    2580 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590148    2580 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590151    2580 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590154    2580 flags.go:64] FLAG: --logging-format="text"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590157    2580 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590160    2580 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590163    2580 flags.go:64] FLAG: --manifest-url=""
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590166    2580 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590171    2580 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590174    2580 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590178    2580 flags.go:64] FLAG: --max-pods="110"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590181    2580 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590184    2580 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590187    2580 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590190    2580 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590193    2580 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590196    2580 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 00:02:37.598638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590199    2580 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590207    2580 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590210    2580 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590213    2580 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590216    2580 flags.go:64] FLAG: --pod-cidr=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590220    2580 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590226    2580 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590229    2580 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590232    2580 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590235    2580 flags.go:64] FLAG: --port="10250"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590238    2580 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590241    2580 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0a9e341fa21b067f9"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590254    2580 flags.go:64] FLAG: --qos-reserved=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590258    2580 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590261    2580 flags.go:64] FLAG: --register-node="true"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590264    2580 flags.go:64] FLAG: --register-with-taints=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590269    2580 flags.go:64] FLAG: --registry-burst="10"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590279    2580 flags.go:64] FLAG: --registry-qps="5"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590282    2580 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590285    2580 flags.go:64] FLAG: --reserved-memory=""
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590289    2580 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590292    2580 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590295    2580 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590298    2580 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590301    2580 flags.go:64] FLAG: --runonce="false"
Sep 08 00:02:37.599596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590304    2580 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590307    2580 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590310    2580 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590313    2580 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590316    2580 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590319    2580 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590322    2580 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590326    2580 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590328    2580 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590331    2580 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590334    2580 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590337    2580 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590341    2580 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590344    2580 flags.go:64] FLAG: --system-cgroups=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590347    2580 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590352    2580 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590355    2580 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590358    2580 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590365    2580 flags.go:64] FLAG: --tls-min-version=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590381    2580 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590385    2580 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590389    2580 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590393    2580 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590396    2580 flags.go:64] FLAG: --v="2"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590400    2580 flags.go:64] FLAG: --version="false"
Sep 08 00:02:37.600516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590410    2580 flags.go:64] FLAG: --vmodule=""
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590414    2580 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590418    2580 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590569    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590575    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590578    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590581    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590584    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590586    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590590    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590592    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590595    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590598    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590601    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590604    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590608    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590611    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590614    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590616    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590621    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.601422 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590624    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590627    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590629    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590632    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590634    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590637    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590640    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590642    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590645    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590648    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590650    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590653    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590656    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590664    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590667    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590669    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590672    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590675    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590677    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.602248 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590679    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590682    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590684    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590687    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590689    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590692    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590694    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590697    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590699    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590702    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590704    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590707    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590711    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590713    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590716    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590718    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590721    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590724    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590727    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.602962 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590730    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590734    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590737    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590750    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590753    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590756    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590758    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590761    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590769    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590772    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590775    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590777    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590780    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590782    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590785    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590788    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590790    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590792    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590795    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590798    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.603667 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590800    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590803    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590807    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590810    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590812    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590818    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590822    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590825    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590828    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590831    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590834    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590836    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590839    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590842    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590846    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590850    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590853    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590856    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590858    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590861    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.604370 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590864    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590874    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590876    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.590879    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.590885    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.598908    2580 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.598929    2580 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.598944    2580 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.598949    2580 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599012    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599018    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599022    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599025    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599028    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.605156 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599031    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599034    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599036    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599040    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599043    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599047    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599050    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599052    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599055    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599058    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599063    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599067    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599071    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599074    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599076    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599079    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599083    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599087    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599090    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599095    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.605696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599098    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599101    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599104    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599107    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599110    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599113    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599116    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599119    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599122    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599125    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599127    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599130    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599133    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599136    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599139    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599142    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599144    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599147    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599150    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599152    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.606413 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599155    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599157    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599159    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599162    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599164    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599168    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599172    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599175    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599178    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599181    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599184    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599186    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599189    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599193    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599196    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599198    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599202    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599205    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599207    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.607263 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599210    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599212    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599215    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599218    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599220    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599223    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599225    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599228    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599230    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599233    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599236    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599238    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599241    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599243    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599246    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599248    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599251    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599253    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599256    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599258    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.607961 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599260    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599263    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599266    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599269    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599271    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599274    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599278    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599280    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599283    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599286    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599289    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599292    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599294    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599297    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.608700 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599300    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.599305    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599444    2580 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599464    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599468    2580 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599471    2580 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599474    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599476    2580 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599479    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599482    2580 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599485    2580 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599487    2580 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599490    2580 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599493    2580 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 00:02:37.609202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599496    2580 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599499    2580 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599501    2580 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599504    2580 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599508    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599510    2580 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599513    2580 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599515    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599518    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599521    2580 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599523    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599527    2580 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599529    2580 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599532    2580 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599536    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599548    2580 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599550    2580 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599553    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599556    2580 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599559    2580 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 00:02:37.609730 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599562    2580 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599565    2580 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599568    2580 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599571    2580 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599573    2580 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599576    2580 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599578    2580 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599581    2580 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599584    2580 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599586    2580 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599589    2580 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599591    2580 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599594    2580 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599596    2580 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599599    2580 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599602    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599605    2580 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599608    2580 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599611    2580 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599613    2580 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 00:02:37.610510 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599616    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599619    2580 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599621    2580 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599624    2580 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599628    2580 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599631    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599633    2580 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599636    2580 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599639    2580 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599641    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599644    2580 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599646    2580 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599649    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599651    2580 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599654    2580 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599656    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599659    2580 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599663    2580 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599667    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599670    2580 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 00:02:37.611276 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599672    2580 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599676    2580 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599679    2580 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599682    2580 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599685    2580 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599688    2580 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599691    2580 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599694    2580 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599696    2580 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599699    2580 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599701    2580 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599704    2580 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599706    2580 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599709    2580 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599711    2580 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599714    2580 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599717    2580 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599720    2580 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599724    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 00:02:37.612015 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599726    2580 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599729    2580 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599731    2580 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599734    2580 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599737    2580 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599741    2580 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599743    2580 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:37.599746    2580 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.599750    2580 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.599885    2580 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.602569    2580 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.603716    2580 server.go:1019] "Starting client certificate rotation"
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.603823    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:02:37.612706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.603868    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 00:02:37.613224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.606647    2580 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:02:37.613224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.608216    2580 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 00:02:37.619077 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.619051    2580 log.go:25] "Validated CRI v1 runtime API"
Sep 08 00:02:37.622661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.622640    2580 log.go:25] "Validated CRI v1 image API"
Sep 08 00:02:37.623617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.623597    2580 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 00:02:37.627218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.627192    2580 fs.go:135] Filesystem UUIDs: map[6b0e46aa-a4d2-4c39-8a58-17b08c41347d:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 98ea47f9-f5b8-4428-9e32-1bd92b94e80c:/dev/nvme0n1p3]
Sep 08 00:02:37.627309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.627215    2580 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 00:02:37.632497 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.632343    2580 manager.go:216] Machine: {Timestamp:2026-09-08 00:02:37.630919792 +0000 UTC m=+0.381616626 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099972 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25eeff47d689b5242685a60db3ce3c SystemUUID:ec25eeff-47d6-89b5-2426-85a60db3ce3c BootID:bfdcf670-30c9-4f3a-b04b-f8bdfb62b29b Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fa:6b:51:63:55 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fa:6b:51:63:55 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ae:59:59:43:b0:c7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 00:02:37.632497 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.632486    2580 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 00:02:37.632640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.632584    2580 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 00:02:37.634200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.634178    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:02:37.634491 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.634466    2580 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 00:02:37.634642 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.634495    2580 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-226.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 00:02:37.635359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.635348    2580 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 00:02:37.635390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.635361    2580 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 00:02:37.635390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.635369    2580 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:02:37.636219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.636205    2580 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 00:02:37.638136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.638123    2580 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 00:02:37.642865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.642849    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:02:37.643002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.642992    2580 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 00:02:37.643043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643025    2580 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 00:02:37.643043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643035    2580 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 00:02:37.643122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643051    2580 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 00:02:37.643122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643063    2580 kubelet.go:398] "Adding apiserver pod source"
Sep 08 00:02:37.643122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643078    2580 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 00:02:37.643469 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643445    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:02:37.643512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.643478    2580 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 00:02:37.645970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.645952    2580 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 00:02:37.648921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.648895    2580 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 00:02:37.649043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.648939    2580 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 00:02:37.649941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649926    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649949    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649955    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649961    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649971    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649977    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649990    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 00:02:37.649995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.649996    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 00:02:37.650269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650003    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 00:02:37.650269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650012    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 00:02:37.650269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650026    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 00:02:37.650269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650032    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 00:02:37.650814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650802    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 00:02:37.650867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.650816    2580 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 00:02:37.652282 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.652255    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 00:02:37.652397 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.652292    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 00:02:37.653953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.653931    2580 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-226.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 00:02:37.655013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.654997    2580 server.go:1268] "Started kubelet"
Sep 08 00:02:37.655335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.655223    2580 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 00:02:37.655335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.655212    2580 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 00:02:37.655335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.655301    2580 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 00:02:37.656169 ip-10-0-135-226 systemd[1]: Started Kubernetes Kubelet.
Sep 08 00:02:37.659124 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.656828    2580 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 00:02:37.660690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.660670    2580 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 00:02:37.661712 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.661685    2580 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 00:02:37.664801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.664775    2580 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 00:02:37.664801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.664792    2580 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 00:02:37.664986 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.664960    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:37.666123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666096    2580 factory.go:55] Registering systemd factory
Sep 08 00:02:37.666123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666116    2580 factory.go:223] Registration of the systemd container factory successfully
Sep 08 00:02:37.666364 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666347    2580 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 00:02:37.666716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666694    2580 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 00:02:37.666850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666838    2580 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 00:02:37.666934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666811    2580 factory.go:153] Registering CRI-O factory
Sep 08 00:02:37.667034 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.666954    2580 factory.go:223] Registration of the crio container factory successfully
Sep 08 00:02:37.667034 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667015    2580 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 00:02:37.667126 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667042    2580 factory.go:103] Registering Raw factory
Sep 08 00:02:37.667126 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667059    2580 manager.go:1196] Started watching for new ooms in manager
Sep 08 00:02:37.667224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667160    2580 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 00:02:37.667224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667170    2580 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 00:02:37.667342 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.665270    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-226.ec2.internal.18d32f8c8a17ddd1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-226.ec2.internal,UID:ip-10-0-135-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-226.ec2.internal,},FirstTimestamp:2026-09-08 00:02:37.654965713 +0000 UTC m=+0.405662549,LastTimestamp:2026-09-08 00:02:37.654965713 +0000 UTC m=+0.405662549,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-226.ec2.internal,}"
Sep 08 00:02:37.667493 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.667479    2580 manager.go:349] Starting recovery of all containers
Sep 08 00:02:37.672961 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.672925    2580 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-226.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 00:02:37.673142 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.672949    2580 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 00:02:37.677468 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.677418    2580 manager.go:354] Recovery completed
Sep 08 00:02:37.679023 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.679000    2580 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 00:02:37.679626 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.679604    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dg89"
Sep 08 00:02:37.682441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.682427    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.684403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.684384    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9dg89"
Sep 08 00:02:37.685019 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685004    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.685088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685033    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.685088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685045    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.685672 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685658    2580 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 00:02:37.685672 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685670    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.685818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685672    2580 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 00:02:37.685818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.685741    2580 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 00:02:37.686434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.686418    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.686543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.686466    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.686543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.686480    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.687003 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.686924    2580 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-226.ec2.internal.18d32f8c8be270be  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-226.ec2.internal,UID:ip-10-0-135-226.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-135-226.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-135-226.ec2.internal,},FirstTimestamp:2026-09-08 00:02:37.685018814 +0000 UTC m=+0.435715649,LastTimestamp:2026-09-08 00:02:37.685018814 +0000 UTC m=+0.435715649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-226.ec2.internal,}"
Sep 08 00:02:37.688228 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.688214    2580 policy_none.go:49] "None policy: Start"
Sep 08 00:02:37.688294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.688232    2580 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 00:02:37.688294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.688242    2580 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 00:02:37.690238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.690225    2580 policy_none.go:47] "Start"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736242    2580 manager.go:337] "Starting Device Plugin manager"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.736441    2580 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736469    2580 server.go:87] "Starting device plugin registration server"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736715    2580 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736725    2580 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736833    2580 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736932    2580 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.736941    2580 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.737425    2580 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 00:02:37.745701 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.737496    2580 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:37.765534 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.765492    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 00:02:37.766784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.766763    2580 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 00:02:37.766905 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.766821    2580 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 00:02:37.766905 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.766851    2580 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 00:02:37.766992 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.766959    2580 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 00:02:37.769264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.769241    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:37.837573 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.837480    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.838656 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.838640    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.838723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.838676    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.838723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.838692    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.838723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.838718    2580 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.847273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.847253    2580 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.847329 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.847283    2580 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-226.ec2.internal\": node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:37.867170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.867132    2580 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"]
Sep 08 00:02:37.867328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.867217    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.868690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.868669    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.868757 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.868710    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.868757 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.868722    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.871235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.871220    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.871413 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.871398    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.871477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.871430    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.871885 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.871870    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:37.873519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.873504    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.873602 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.873534    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.873602 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.873548    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.874044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.874024    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.874113 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.874062    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.874113 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.874078    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.875903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.875883    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.875997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.875911    2580 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 00:02:37.876737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.876720    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 00:02:37.876809 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.876755    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 00:02:37.876809 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.876769    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeHasSufficientPID"
Sep 08 00:02:37.891125 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.891096    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-226.ec2.internal\" not found" node="ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.894817 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.894796    2580 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-226.ec2.internal\" not found" node="ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.967892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.967853    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a46517dca54415b1b62397a657bd6fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-226.ec2.internal\" (UID: \"7a46517dca54415b1b62397a657bd6fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.967892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.967890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.968095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:37.967918    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:37.972966 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:37.972945    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.069100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.069100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a46517dca54415b1b62397a657bd6fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-226.ec2.internal\" (UID: \"7a46517dca54415b1b62397a657bd6fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.069234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.069234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069182    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.069234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069186    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cb87071c9ccbfd1c9c3c343b94dc6052-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal\" (UID: \"cb87071c9ccbfd1c9c3c343b94dc6052\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.069234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.069204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7a46517dca54415b1b62397a657bd6fb-config\") pod \"kube-apiserver-proxy-ip-10-0-135-226.ec2.internal\" (UID: \"7a46517dca54415b1b62397a657bd6fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.073539 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.073504    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.173874 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.173802    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.194557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.194523    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.197968 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.197947    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.274710 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.274659    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.375763 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.375707    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.476899 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.476840    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.578014 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:38.577975    2580 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-226.ec2.internal\" not found"
Sep 08 00:02:38.604114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.604083    2580 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 00:02:38.604270 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.604252    2580 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 00:02:38.646057 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.646016    2580 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:38.665955 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.665921    2580 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 00:02:38.666162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.665968    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.675261 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.675226    2580 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 00:02:38.678716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.678694    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:02:38.680393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.680374    2580 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal"
Sep 08 00:02:38.688484 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.688439    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-06 23:57:38 +0000 UTC" deadline="2028-04-24 21:44:31.889409488 +0000 UTC"
Sep 08 00:02:38.688566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.688485    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14277h41m53.200928104s"
Sep 08 00:02:38.688758 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.688744    2580 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 00:02:38.700638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.700609    2580 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-67prr"
Sep 08 00:02:38.709214 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.709180    2580 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-67prr"
Sep 08 00:02:38.752820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.752726    2580 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:38.891802 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:38.891765    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb87071c9ccbfd1c9c3c343b94dc6052.slice/crio-6c6fc45645bef2f443e46ce833951ba1994c133886d558342fb6063be9564c28 WatchSource:0}: Error finding container 6c6fc45645bef2f443e46ce833951ba1994c133886d558342fb6063be9564c28: Status 404 returned error can't find the container with id 6c6fc45645bef2f443e46ce833951ba1994c133886d558342fb6063be9564c28
Sep 08 00:02:38.896847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.896828    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:02:38.903100 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:38.903069    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a46517dca54415b1b62397a657bd6fb.slice/crio-68359c2b96687e1e40c74e7709d1883ddaf1943e4256329ede0958c17743b299 WatchSource:0}: Error finding container 68359c2b96687e1e40c74e7709d1883ddaf1943e4256329ede0958c17743b299: Status 404 returned error can't find the container with id 68359c2b96687e1e40c74e7709d1883ddaf1943e4256329ede0958c17743b299
Sep 08 00:02:38.921581 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:38.921540    2580 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:39.644303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.644258    2580 apiserver.go:52] "Watching apiserver"
Sep 08 00:02:39.653187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.653152    2580 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 00:02:39.653722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.653692    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-fqdnr","kube-system/global-pull-secret-syncer-vz4z5","openshift-image-registry/node-ca-9bswq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal","openshift-multus/multus-kv64m","openshift-network-operator/iptables-alerter-wcfkf","openshift-ovn-kubernetes/ovnkube-node-jf4ws","kube-system/konnectivity-agent-frm6j","kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct","openshift-cluster-node-tuning-operator/tuned-742m9","openshift-dns/node-resolver-qdl9t","openshift-multus/multus-additional-cni-plugins-jzp4x","openshift-multus/network-metrics-daemon-kl7st"]
Sep 08 00:02:39.656588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.656561    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.659028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.658999    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.659177 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.659105    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:39.659256 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.659238    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 00:02:39.659311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.659255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-76fwz\""
Sep 08 00:02:39.659311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.659262    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 00:02:39.661529 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.661488    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.663902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.663877    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:39.664028 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.663960    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:39.665423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.664977    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 00:02:39.665423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.664995    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.665423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.665032    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.665423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.664980    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-b8qc7\""
Sep 08 00:02:39.667147 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.666573    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.669219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.669194    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 00:02:39.669443 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.669425    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.669670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.669650    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-r87wj\""
Sep 08 00:02:39.669756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.669677    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.669847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.669823    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.672412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.671985    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.672412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.672083    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.672412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.672195    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 00:02:39.672893 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.672865    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.673594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.673571    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 00:02:39.673707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.673597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qggnf\""
Sep 08 00:02:39.673707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.673640    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 00:02:39.674255 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.674235    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.674485 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.674433    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 00:02:39.674788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.674773    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.675231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.675202    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 00:02:39.675685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.675666    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.675685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.675676    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 00:02:39.676206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.676187    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-pgtq5\""
Sep 08 00:02:39.677098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.677079    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 00:02:39.677380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.677358    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-klw5t\""
Sep 08 00:02:39.677481 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.677448    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.678008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.677817    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.678908 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.678540    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.680642 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-kubelet\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-systemd-units\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680674    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.680765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680755    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-netns\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680782    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680810    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-etc-selinux\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovn-node-metrics-cert\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680914    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-script-lib\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.680987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680963    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad1249e1-5fae-4f9e-a014-568cee96101b-agent-certs\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.680994    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtlpv\" (UniqueName: \"kubernetes.io/projected/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kube-api-access-mtlpv\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-systemd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681050    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-ovn\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681104    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-iptables-alerter-script\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/0d159f5c-f279-48c1-affe-777c263a95e2-kube-api-access-vj8ct\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681167    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-registration-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-device-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681216    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs5zp\" (UniqueName: \"kubernetes.io/projected/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-kube-api-access-fs5zp\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-slash\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-var-lib-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681319    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-log-socket\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-xf544\""
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-netd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad1249e1-5fae-4f9e-a014-568cee96101b-konnectivity-ca\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-sys-fs\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681516    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-host-slash\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681543    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-etc-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681571    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-bin\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681624    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-config\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.681994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681638    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.681656    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-env-overrides\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.682170    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjqlx\" (UniqueName: \"kubernetes.io/projected/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-kube-api-access-zjqlx\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.682195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.682243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-socket-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.682267    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.682474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.682302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-node-log\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.684051 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.684033    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 00:02:39.684282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.684230    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 00:02:39.684450 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.684431    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dfkcx\""
Sep 08 00:02:39.686586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.686564    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.688778 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.688755    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 00:02:39.689537 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.689511    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w4hw9\""
Sep 08 00:02:39.691392 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.691370    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.691508 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.691455    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:39.692264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.692092    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 00:02:39.712327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.712201    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 23:57:39 +0000 UTC" deadline="2028-05-21 12:25:05.726408906 +0000 UTC"
Sep 08 00:02:39.712327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.712266    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14916h22m26.014147698s"
Sep 08 00:02:39.767264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.767230    2580 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 00:02:39.773385 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.773315    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal" event={"ID":"cb87071c9ccbfd1c9c3c343b94dc6052","Type":"ContainerStarted","Data":"6c6fc45645bef2f443e46ce833951ba1994c133886d558342fb6063be9564c28"}
Sep 08 00:02:39.774801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.774757    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal" event={"ID":"7a46517dca54415b1b62397a657bd6fb","Type":"ContainerStarted","Data":"68359c2b96687e1e40c74e7709d1883ddaf1943e4256329ede0958c17743b299"}
Sep 08 00:02:39.782923 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.782887    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-etc-selinux\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.782923 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.782924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovn-node-metrics-cert\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.782945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-kubernetes\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.783156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.782964    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.783156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783020    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-dbus\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.783156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-etc-selinux\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.783337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.783337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783208    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad1249e1-5fae-4f9e-a014-568cee96101b-agent-certs\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.783337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-ovn\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783284    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk2ss\" (UniqueName: \"kubernetes.io/projected/7472943a-9a97-40dc-99b9-ed611eafe0a0-kube-api-access-qk2ss\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.783337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-hosts-file\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-iptables-alerter-script\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-ovn\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783409    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-tmp\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783470    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-system-cni-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783509    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-netns\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783540    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-multus-certs\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-host\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.783611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-registration-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-var-lib-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783705    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-var-lib-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783756    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-env-overrides\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783833    2580 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-registration-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cnibin\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783950    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.783998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.783983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn497\" (UniqueName: \"kubernetes.io/projected/26c79ab4-8561-49ae-8674-2807f67b06a7-kube-api-access-mn497\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784024    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad1249e1-5fae-4f9e-a014-568cee96101b-konnectivity-ca\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784050    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-etc-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784163    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-etc-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-config\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784317    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjqlx\" (UniqueName: \"kubernetes.io/projected/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-kube-api-access-zjqlx\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-system-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784381    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-bin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.784419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784411    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-env-overrides\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-socket-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784622    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-socket-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784672    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ad1249e1-5fae-4f9e-a014-568cee96101b-konnectivity-ca\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784716    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-node-log\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-conf\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784808    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-openvswitch\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.784820    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-etc-kubernetes\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.784845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784851    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-kubelet\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784857    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-node-log\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784871    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-systemd-units\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784890    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-iptables-alerter-script\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.784910    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:40.284871239 +0000 UTC m=+3.035568062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784921    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-kubelet\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-systemd-units\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.784985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-script-lib\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785002    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7472943a-9a97-40dc-99b9-ed611eafe0a0-serviceca\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785123    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-var-lib-kubelet\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785156    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-cnibin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785180    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-config\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785200    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-k8s-cni-cncf-io\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785277    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-multus\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785324    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-conf-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.785393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtlpv\" (UniqueName: \"kubernetes.io/projected/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kube-api-access-mtlpv\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785476    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-systemd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785564    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-lib-modules\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785588    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-tuned\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785590    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-run-systemd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9p2tc\" (UniqueName: \"kubernetes.io/projected/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-kube-api-access-9p2tc\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovnkube-script-lib\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785709    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpr7b\" (UniqueName: \"kubernetes.io/projected/15d15f9e-111c-4a27-93c8-1c271dc9431a-kube-api-access-hpr7b\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-socket-dir-parent\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-hostroot\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/0d159f5c-f279-48c1-affe-777c263a95e2-kube-api-access-vj8ct\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785843    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-device-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785913    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs5zp\" (UniqueName: \"kubernetes.io/projected/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-kube-api-access-fs5zp\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.786222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785920    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-device-dir\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-slash\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785973    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-log-socket\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.785997    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-netd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-slash\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-kubelet\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786061    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-sys\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-log-socket\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786081    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-sys-fs\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786122    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/27ab1a5e-4165-4744-9a4f-4f8c563e4769-sys-fs\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786158    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-host-slash\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786145    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-netd\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786200    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-bin\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-host-slash\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7472943a-9a97-40dc-99b9-ed611eafe0a0-host\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786247    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-cni-bin\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786265    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-tmp-dir\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.787061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4dg\" (UniqueName: \"kubernetes.io/projected/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-kube-api-access-qn4dg\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786327    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786351    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-run\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786408    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-modprobe-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786487    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-systemd\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786519    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-cni-binary-copy\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-daemon-config\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786587    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-netns\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786659    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786715    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysconfig\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786767    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-host-run-netns\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786771    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.787829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.786801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-kubelet-config\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.788430 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.788350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-ovn-node-metrics-cert\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.788430 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.788416    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ad1249e1-5fae-4f9e-a014-568cee96101b-agent-certs\") pod \"konnectivity-agent-frm6j\" (UID: \"ad1249e1-5fae-4f9e-a014-568cee96101b\") " pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.794753 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.794725    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:39.794908 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.794773    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:39.794908 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.794789    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:39.794908 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.794863    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:40.294843358 +0000 UTC m=+3.045540186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:39.798418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.798389    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8ct\" (UniqueName: \"kubernetes.io/projected/0d159f5c-f279-48c1-affe-777c263a95e2-kube-api-access-vj8ct\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:39.798561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.798377    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs5zp\" (UniqueName: \"kubernetes.io/projected/ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d-kube-api-access-fs5zp\") pod \"iptables-alerter-wcfkf\" (UID: \"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d\") " pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:39.798954 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.798931    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjqlx\" (UniqueName: \"kubernetes.io/projected/d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad-kube-api-access-zjqlx\") pod \"ovnkube-node-jf4ws\" (UID: \"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad\") " pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:39.799142 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.799118    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtlpv\" (UniqueName: \"kubernetes.io/projected/27ab1a5e-4165-4744-9a4f-4f8c563e4769-kube-api-access-mtlpv\") pod \"aws-ebs-csi-driver-node-lcrct\" (UID: \"27ab1a5e-4165-4744-9a4f-4f8c563e4769\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.880162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.880129    2580 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 00:02:39.888187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888151    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-conf\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-etc-kubernetes\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888273    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-etc-kubernetes\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7472943a-9a97-40dc-99b9-ed611eafe0a0-serviceca\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888336    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-var-lib-kubelet\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888361    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-cnibin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-conf\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888395    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-k8s-cni-cncf-io\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-k8s-cni-cncf-io\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888453 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888442    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-multus\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-conf-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888503    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-cnibin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-var-lib-kubelet\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888547    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-lib-modules\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888550    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-multus\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-tuned\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888601    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9p2tc\" (UniqueName: \"kubernetes.io/projected/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-kube-api-access-9p2tc\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888625    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888652    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpr7b\" (UniqueName: \"kubernetes.io/projected/15d15f9e-111c-4a27-93c8-1c271dc9431a-kube-api-access-hpr7b\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-socket-dir-parent\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888692    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysctl-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888696    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-hostroot\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-hostroot\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888742    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-kubelet\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888770    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-sys\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7472943a-9a97-40dc-99b9-ed611eafe0a0-host\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.888888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-tmp-dir\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-lib-modules\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888870    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4dg\" (UniqueName: \"kubernetes.io/projected/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-kube-api-access-qn4dg\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-run\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-modprobe-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.888977    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-systemd\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-cni-binary-copy\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889030    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-daemon-config\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7472943a-9a97-40dc-99b9-ed611eafe0a0-serviceca\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysconfig\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889112    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-kubelet-config\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-kubernetes\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889263    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-kubernetes\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-sysconfig\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889470    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-sys\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7472943a-9a97-40dc-99b9-ed611eafe0a0-host\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.889792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889557    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-conf-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889596    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-kubelet\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889650    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-run\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889714    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-daemon-config\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889851    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-modprobe-d\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-tmp-dir\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889868    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-systemd\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889926    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889959    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-dbus\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-kubelet-config\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889986    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.889986    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-multus-socket-dir-parent\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890011    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cni-binary-copy\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890034    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk2ss\" (UniqueName: \"kubernetes.io/projected/7472943a-9a97-40dc-99b9-ed611eafe0a0-kube-api-access-qk2ss\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-hosts-file\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.890081    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:39.890720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890093    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-tmp\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/771a2276-e098-496d-adef-c937a913a59f-dbus\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-system-cni-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:39.890145    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:02:40.390125699 +0000 UTC m=+3.140822539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-system-cni-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890164    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-hosts-file\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-netns\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-multus-certs\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890230    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-host\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890259    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cnibin\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890312    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn497\" (UniqueName: \"kubernetes.io/projected/26c79ab4-8561-49ae-8674-2807f67b06a7-kube-api-access-mn497\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-system-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-bin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/15d15f9e-111c-4a27-93c8-1c271dc9431a-cni-binary-copy\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890445    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/26c79ab4-8561-49ae-8674-2807f67b06a7-host\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890461    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-var-lib-cni-bin\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.891498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-netns\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890508    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-host-run-multus-certs\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-tuning-conf-dir\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-cnibin\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.890737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/15d15f9e-111c-4a27-93c8-1c271dc9431a-system-cni-dir\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.892362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.891902    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-etc-tuned\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.892689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.892668    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/26c79ab4-8561-49ae-8674-2807f67b06a7-tmp\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.898143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.898063    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpr7b\" (UniqueName: \"kubernetes.io/projected/15d15f9e-111c-4a27-93c8-1c271dc9431a-kube-api-access-hpr7b\") pod \"multus-kv64m\" (UID: \"15d15f9e-111c-4a27-93c8-1c271dc9431a\") " pod="openshift-multus/multus-kv64m"
Sep 08 00:02:39.898615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.898576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9p2tc\" (UniqueName: \"kubernetes.io/projected/89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763-kube-api-access-9p2tc\") pod \"node-resolver-qdl9t\" (UID: \"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763\") " pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:39.898773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.898752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4dg\" (UniqueName: \"kubernetes.io/projected/51e6f0fc-b698-458b-8f48-6fc70bbd19f3-kube-api-access-qn4dg\") pod \"multus-additional-cni-plugins-jzp4x\" (UID: \"51e6f0fc-b698-458b-8f48-6fc70bbd19f3\") " pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:39.900115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.900089    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn497\" (UniqueName: \"kubernetes.io/projected/26c79ab4-8561-49ae-8674-2807f67b06a7-kube-api-access-mn497\") pod \"tuned-742m9\" (UID: \"26c79ab4-8561-49ae-8674-2807f67b06a7\") " pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:39.900350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.900320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk2ss\" (UniqueName: \"kubernetes.io/projected/7472943a-9a97-40dc-99b9-ed611eafe0a0-kube-api-access-qk2ss\") pod \"node-ca-9bswq\" (UID: \"7472943a-9a97-40dc-99b9-ed611eafe0a0\") " pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:39.969813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.969775    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:02:39.980807 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.980777    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct"
Sep 08 00:02:39.981738 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:39.981700    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad1249e1_5fae_4f9e_a014_568cee96101b.slice/crio-89e6f75fb22ad62145a877dfd4f4843cd5fa2b1e50de0446be258a9d6fbd2d20 WatchSource:0}: Error finding container 89e6f75fb22ad62145a877dfd4f4843cd5fa2b1e50de0446be258a9d6fbd2d20: Status 404 returned error can't find the container with id 89e6f75fb22ad62145a877dfd4f4843cd5fa2b1e50de0446be258a9d6fbd2d20
Sep 08 00:02:39.994264 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:39.994218    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ab1a5e_4165_4744_9a4f_4f8c563e4769.slice/crio-6ddf7be5733ccc7d6eec46a38bb558e9a917569632b862565de7361118945ad7 WatchSource:0}: Error finding container 6ddf7be5733ccc7d6eec46a38bb558e9a917569632b862565de7361118945ad7: Status 404 returned error can't find the container with id 6ddf7be5733ccc7d6eec46a38bb558e9a917569632b862565de7361118945ad7
Sep 08 00:02:39.995359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:39.995329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:02:40.002447 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.002416    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wcfkf"
Sep 08 00:02:40.006605 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.006573    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61c1ca6_b93c_4c9a_bb2f_0023316bd7ad.slice/crio-646b52d1b0213abbd882a55130c4f1d599588a64c6dbafd001bdb990b9de02aa WatchSource:0}: Error finding container 646b52d1b0213abbd882a55130c4f1d599588a64c6dbafd001bdb990b9de02aa: Status 404 returned error can't find the container with id 646b52d1b0213abbd882a55130c4f1d599588a64c6dbafd001bdb990b9de02aa
Sep 08 00:02:40.009746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.009671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kv64m"
Sep 08 00:02:40.012696 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.012657    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee9b880d_5b6d_4f25_9a15_2b00d77b3f1d.slice/crio-4d9d3a7710ac9364b3d34be2a261167b98f8005519b974558e08b409726cf985 WatchSource:0}: Error finding container 4d9d3a7710ac9364b3d34be2a261167b98f8005519b974558e08b409726cf985: Status 404 returned error can't find the container with id 4d9d3a7710ac9364b3d34be2a261167b98f8005519b974558e08b409726cf985
Sep 08 00:02:40.018677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.018653    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9bswq"
Sep 08 00:02:40.020063 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.020026    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15d15f9e_111c_4a27_93c8_1c271dc9431a.slice/crio-be4ab8540c2adaca831f24cb04597dd7cd93d7d606e0b7d92eb53c89b01c2ec6 WatchSource:0}: Error finding container be4ab8540c2adaca831f24cb04597dd7cd93d7d606e0b7d92eb53c89b01c2ec6: Status 404 returned error can't find the container with id be4ab8540c2adaca831f24cb04597dd7cd93d7d606e0b7d92eb53c89b01c2ec6
Sep 08 00:02:40.030214 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.030174    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7472943a_9a97_40dc_99b9_ed611eafe0a0.slice/crio-4f528f916becf90a30df047593c2cee1ec0503b351090c3c3dbeb7b015f5f694 WatchSource:0}: Error finding container 4f528f916becf90a30df047593c2cee1ec0503b351090c3c3dbeb7b015f5f694: Status 404 returned error can't find the container with id 4f528f916becf90a30df047593c2cee1ec0503b351090c3c3dbeb7b015f5f694
Sep 08 00:02:40.035854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.035827    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-742m9"
Sep 08 00:02:40.045449 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.045420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qdl9t"
Sep 08 00:02:40.046965 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.046939    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26c79ab4_8561_49ae_8674_2807f67b06a7.slice/crio-cea78aaf664bcd72f96a28533a51670c291d7d897f36d3ab15653c634d339b6b WatchSource:0}: Error finding container cea78aaf664bcd72f96a28533a51670c291d7d897f36d3ab15653c634d339b6b: Status 404 returned error can't find the container with id cea78aaf664bcd72f96a28533a51670c291d7d897f36d3ab15653c634d339b6b
Sep 08 00:02:40.050858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.050838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-jzp4x"
Sep 08 00:02:40.058380 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.058344    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ec8fb0_7e1d_4fae_ae9c_7c768bdfc763.slice/crio-7ea20f76aa92caa6ff7f09b58a267a8b0d2b4f8bf79ce51a284973d953647f9d WatchSource:0}: Error finding container 7ea20f76aa92caa6ff7f09b58a267a8b0d2b4f8bf79ce51a284973d953647f9d: Status 404 returned error can't find the container with id 7ea20f76aa92caa6ff7f09b58a267a8b0d2b4f8bf79ce51a284973d953647f9d
Sep 08 00:02:40.062437 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:02:40.062411    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51e6f0fc_b698_458b_8f48_6fc70bbd19f3.slice/crio-cb8a677efcb6dad43e0cfd73f3709735aa65a285ca7a59091a614a4fd362ba88 WatchSource:0}: Error finding container cb8a677efcb6dad43e0cfd73f3709735aa65a285ca7a59091a614a4fd362ba88: Status 404 returned error can't find the container with id cb8a677efcb6dad43e0cfd73f3709735aa65a285ca7a59091a614a4fd362ba88
Sep 08 00:02:40.294165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.294058    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:40.294351 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.294242    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:40.294351 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.294335    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:41.294312906 +0000 UTC m=+4.045009729 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:40.394961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.394891    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.394983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395083    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395114    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395132    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395145    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:40.395172 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395165    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:02:41.395146261 +0000 UTC m=+4.145843109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:40.395532 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.395183    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:41.39517302 +0000 UTC m=+4.145869865 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:40.713181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.713108    2580 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-06 23:57:39 +0000 UTC" deadline="2028-04-17 02:19:35.068922255 +0000 UTC"
Sep 08 00:02:40.713181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.713178    2580 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14090h16m54.355753178s"
Sep 08 00:02:40.768109 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.767690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:40.768109 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:40.767841    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:40.779424 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.779336    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdl9t" event={"ID":"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763","Type":"ContainerStarted","Data":"7ea20f76aa92caa6ff7f09b58a267a8b0d2b4f8bf79ce51a284973d953647f9d"}
Sep 08 00:02:40.785414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.785299    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bswq" event={"ID":"7472943a-9a97-40dc-99b9-ed611eafe0a0","Type":"ContainerStarted","Data":"4f528f916becf90a30df047593c2cee1ec0503b351090c3c3dbeb7b015f5f694"}
Sep 08 00:02:40.787616 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.787529    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kv64m" event={"ID":"15d15f9e-111c-4a27-93c8-1c271dc9431a","Type":"ContainerStarted","Data":"be4ab8540c2adaca831f24cb04597dd7cd93d7d606e0b7d92eb53c89b01c2ec6"}
Sep 08 00:02:40.793382 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.793266    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcfkf" event={"ID":"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d","Type":"ContainerStarted","Data":"4d9d3a7710ac9364b3d34be2a261167b98f8005519b974558e08b409726cf985"}
Sep 08 00:02:40.800193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.800143    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"646b52d1b0213abbd882a55130c4f1d599588a64c6dbafd001bdb990b9de02aa"}
Sep 08 00:02:40.805521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.805482    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct" event={"ID":"27ab1a5e-4165-4744-9a4f-4f8c563e4769","Type":"ContainerStarted","Data":"6ddf7be5733ccc7d6eec46a38bb558e9a917569632b862565de7361118945ad7"}
Sep 08 00:02:40.813889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.813846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerStarted","Data":"cb8a677efcb6dad43e0cfd73f3709735aa65a285ca7a59091a614a4fd362ba88"}
Sep 08 00:02:40.817870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.817762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-742m9" event={"ID":"26c79ab4-8561-49ae-8674-2807f67b06a7","Type":"ContainerStarted","Data":"cea78aaf664bcd72f96a28533a51670c291d7d897f36d3ab15653c634d339b6b"}
Sep 08 00:02:40.820070 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:40.819994    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frm6j" event={"ID":"ad1249e1-5fae-4f9e-a014-568cee96101b","Type":"ContainerStarted","Data":"89e6f75fb22ad62145a877dfd4f4843cd5fa2b1e50de0446be258a9d6fbd2d20"}
Sep 08 00:02:41.302956 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.302629    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:41.303134 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.302951    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:41.303134 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.303038    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.303015856 +0000 UTC m=+6.053712683 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:41.404336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.404124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:41.404336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.404220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:41.404645 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.404358    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:41.404645 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.404453    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.404434779 +0000 UTC m=+6.155131604 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:41.405050 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.405024    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:41.405050 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.405049    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:41.405218 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.405063    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:41.405218 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.405126    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:43.405108589 +0000 UTC m=+6.155805428 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:41.770635 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.770105    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:41.770635 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.770263    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:41.771615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.771341    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:41.771615 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:41.771461    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:41.844193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.844147    2580 generic.go:356] "Generic (PLEG): container finished" podID="cb87071c9ccbfd1c9c3c343b94dc6052" containerID="f11c207b9fd82a1f2003d21523ba51a4a2240540998f109f66bb82789f473c3a" exitCode=0
Sep 08 00:02:41.844390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:41.844215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal" event={"ID":"cb87071c9ccbfd1c9c3c343b94dc6052","Type":"ContainerDied","Data":"f11c207b9fd82a1f2003d21523ba51a4a2240540998f109f66bb82789f473c3a"}
Sep 08 00:02:42.767600 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:42.767457    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:42.767782 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:42.767614    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:42.852228 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:42.852135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal" event={"ID":"cb87071c9ccbfd1c9c3c343b94dc6052","Type":"ContainerStarted","Data":"69d7d2695e099382201982c9820b15d5c39d03f3689da98b71ea51c590ce24b5"}
Sep 08 00:02:42.867017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:42.866944    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-226.ec2.internal" podStartSLOduration=3.866919393 podStartE2EDuration="3.866919393s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:42.866502229 +0000 UTC m=+5.617199077" watchObservedRunningTime="2026-09-08 00:02:42.866919393 +0000 UTC m=+5.617616243"
Sep 08 00:02:43.321386 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:43.321343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:43.321611 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.321541    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:43.321674 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.321625    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:47.321601995 +0000 UTC m=+10.072298848 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:43.422080 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:43.422036    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:43.422251 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:43.422132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:43.422296 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422254    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:43.422296 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422277    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:43.422296 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422282    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:43.422392 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422301    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:43.422392 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422351    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:02:47.422328703 +0000 UTC m=+10.173025529 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:43.422392 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.422373    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:47.422362291 +0000 UTC m=+10.173059144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:43.768679 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:43.768591    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:43.768841 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.768740    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:43.769277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:43.769254    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:43.769412 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:43.769390    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:44.768069 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:44.767515    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:44.768069 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:44.767674    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:45.768722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:45.768136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:45.768722 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:45.768293    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:45.769608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:45.769410    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:45.769608 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:45.769564    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:46.767741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:46.767695    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:46.767931 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:46.767848    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:47.359313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:47.359270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:47.359866 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.359424    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:47.359866 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.359515    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:02:55.359478972 +0000 UTC m=+18.110175812 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:47.459957 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:47.459909    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:47.460138 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:47.460008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:47.460138 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460077    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:47.460138 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460104    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:47.460138 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460119    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:47.460305 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460153    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:47.460305 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460192    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:02:55.460172172 +0000 UTC m=+18.210869000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:47.460305 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.460214    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:02:55.460203278 +0000 UTC m=+18.210900107 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:47.769107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:47.769063    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:47.769319 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.769199    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:47.769319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:47.769264    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:47.769433 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:47.769347    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:48.767647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:48.767607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:48.768158 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:48.767754    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:49.768165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:49.768130    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:49.768696 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:49.768298    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:49.768926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:49.768830    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:49.769056 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:49.768976    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:50.767717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:50.767671    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:50.767883 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:50.767812    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:51.767955 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:51.767918    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:51.768512 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:51.768045    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:51.768512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:51.768101    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:51.768512 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:51.768227    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:52.767255 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:52.767214    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:52.767445 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:52.767357    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:53.768023 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:53.767984    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:53.768531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:53.767989    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:53.768531 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:53.768107    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:53.768531 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:53.768184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:54.767049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:54.767007    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:54.767276 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:54.767134    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:55.426540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:55.426492    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:55.427039 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.426678    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:55.427039 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.426764    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:11.426747593 +0000 UTC m=+34.177444428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:02:55.527088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:55.527047    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:55.527266 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:55.527118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:55.527266 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527234    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:55.527355 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527314    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:03:11.527295249 +0000 UTC m=+34.277992091 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:02:55.527355 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527237    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:02:55.527470 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527357    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:02:55.527470 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527371    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:55.527470 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.527428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:03:11.527411692 +0000 UTC m=+34.278108519 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:02:55.767828 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:55.767791    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:55.768019 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.767939    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:55.768019 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:55.767993    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:55.768135 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:55.768111    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:56.767812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:56.767772    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:56.768281 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:56.767901    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:57.768560 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:57.768519    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:57.768970 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:57.768662    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:57.768970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:57.768722    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:57.768970 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:57.768850    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:58.767729 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:58.767690    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:02:58.767938 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:58.767835    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:02:59.769860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.769608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:02:59.770408 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:59.769979    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:02:59.770699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.770677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:02:59.770854 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:02:59.770833    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:02:59.891037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.891000    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qdl9t" event={"ID":"89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763","Type":"ContainerStarted","Data":"ea67c915533985e3ed52dc91b3974abe2c046d81a040007d73fd23305cbe3ed3"}
Sep 08 00:02:59.900143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.899391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9bswq" event={"ID":"7472943a-9a97-40dc-99b9-ed611eafe0a0","Type":"ContainerStarted","Data":"9ab593bd48dd92238b53ab6cedeeb0c2fca207f8321d6bd466fe4ce6a58feed5"}
Sep 08 00:02:59.903856 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.903755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kv64m" event={"ID":"15d15f9e-111c-4a27-93c8-1c271dc9431a","Type":"ContainerStarted","Data":"1841195b8ef8b08bef59ee1d8a49cd17e3cc45a779a46a4b27792c9a4b6ec74e"}
Sep 08 00:02:59.911860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.910980    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"4c92ef8383616eadb9b51fcb66653d74ce1b84c4e148dd300eba10148a9dc4be"}
Sep 08 00:02:59.911860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.911165    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qdl9t" podStartSLOduration=1.33277881 podStartE2EDuration="20.911146183s" totalImagesPullingTime="19.578367373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.90709845 +0000 UTC m=+22.657795274" watchObservedRunningTime="2026-09-08 00:02:59.911146183 +0000 UTC m=+22.661843031"
Sep 08 00:02:59.913528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.913496    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct" event={"ID":"27ab1a5e-4165-4744-9a4f-4f8c563e4769","Type":"ContainerStarted","Data":"b35d79f2e4354620eec2e565261ae676c0543a9490101c99ba6928238f9b8eed"}
Sep 08 00:02:59.915503 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.915475    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal" event={"ID":"7a46517dca54415b1b62397a657bd6fb","Type":"ContainerStarted","Data":"bcc7d40e71990282cfbd91eb83a247e013645483f833d198b451bb65ebe7c7de"}
Sep 08 00:02:59.917826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.917799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerStarted","Data":"cf6e7aef68363a82a9fee19b4a80536a75d8c7087d7a7cae2256ec4da5a24bdc"}
Sep 08 00:02:59.919745 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.919711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-742m9" event={"ID":"26c79ab4-8561-49ae-8674-2807f67b06a7","Type":"ContainerStarted","Data":"2edc6339352cf09fbc35b181438c50d1d99358b89f8a39870657b159d5ce4e32"}
Sep 08 00:02:59.921788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.921752    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-frm6j" event={"ID":"ad1249e1-5fae-4f9e-a014-568cee96101b","Type":"ContainerStarted","Data":"cb5c097b972a0ae126bd4dfb97352582550bac92171e10e54760bd01cb4efeda"}
Sep 08 00:02:59.925020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.924975    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kv64m" podStartSLOduration=1.254574198 podStartE2EDuration="20.92496029s" totalImagesPullingTime="19.670386092s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.924746508 +0000 UTC m=+22.675443344" watchObservedRunningTime="2026-09-08 00:02:59.92496029 +0000 UTC m=+22.675657134"
Sep 08 00:02:59.953144 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.953086    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-742m9" podStartSLOduration=1.3538098729999999 podStartE2EDuration="20.95306593s" totalImagesPullingTime="19.599256057s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.952974744 +0000 UTC m=+22.703671581" watchObservedRunningTime="2026-09-08 00:02:59.95306593 +0000 UTC m=+22.703762775"
Sep 08 00:02:59.953533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.953488    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9bswq" podStartSLOduration=1.358601486 podStartE2EDuration="20.953474323s" totalImagesPullingTime="19.594872837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.938796356 +0000 UTC m=+22.689493226" watchObservedRunningTime="2026-09-08 00:02:59.953474323 +0000 UTC m=+22.704171159"
Sep 08 00:02:59.970628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.970566    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-226.ec2.internal" podStartSLOduration=20.970550111 podStartE2EDuration="20.970550111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.970150156 +0000 UTC m=+22.720847001" watchObservedRunningTime="2026-09-08 00:02:59.970550111 +0000 UTC m=+22.721246955"
Sep 08 00:02:59.993608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:02:59.993553    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-frm6j" podStartSLOduration=2.350669048 podStartE2EDuration="21.993534558s" totalImagesPullingTime="19.64286551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:02:59.99345965 +0000 UTC m=+22.744156496" watchObservedRunningTime="2026-09-08 00:02:59.993534558 +0000 UTC m=+22.744231392"
Sep 08 00:03:00.767611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.767582    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:00.767829 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:00.767685    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:00.927382 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.927348    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"87765a7336feb5e10cce8513d54ac6cda3b99a824e52222c8d079d74a3e016cf"}
Sep 08 00:03:00.927762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.927427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"280d6cf9c6e60554d186382a4a262f93d754f6047f5e16e94e090d5c5a3691da"}
Sep 08 00:03:00.927762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.927486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"37eba9c4f70b0b86992c489816f4429cb0360f31d01ddc77d7526fe2233d98b6"}
Sep 08 00:03:00.927762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.927520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"6cdd4550ae8e2f41f897b1a28029d2dd81b4e7e4b7a1ea2170c5f807b7078c28"}
Sep 08 00:03:00.927762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.927558    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"0ee7a341078f9d6ac3bdeea89c3e5b37d28c2a9ffd2ba1b5933e392b18d6f65c"}
Sep 08 00:03:00.928968 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.928940    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="cf6e7aef68363a82a9fee19b4a80536a75d8c7087d7a7cae2256ec4da5a24bdc" exitCode=0
Sep 08 00:03:00.929083 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:00.929033    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"cf6e7aef68363a82a9fee19b4a80536a75d8c7087d7a7cae2256ec4da5a24bdc"}
Sep 08 00:03:01.404623 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.404594    2580 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 00:03:01.749672 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.749533    2580 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T00:03:01.404614137Z","UUID":"7e32fceb-11ed-463d-98dd-2e11e5818eb8","Handler":null,"Name":"","Endpoint":""}
Sep 08 00:03:01.751305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.751277    2580 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 00:03:01.751465 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.751314    2580 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 00:03:01.768147 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.768112    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:01.768147 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.768129    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:01.768380 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:01.768220    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:01.768380 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:01.768356    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:01.933550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.933505    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wcfkf" event={"ID":"ee9b880d-5b6d-4f25-9a15-2b00d77b3f1d","Type":"ContainerStarted","Data":"8d4df35211ef9e5142c3b95aa15ee55bf32d69cde1fa1dea206e00ecdbf03d3e"}
Sep 08 00:03:01.935906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.935875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct" event={"ID":"27ab1a5e-4165-4744-9a4f-4f8c563e4769","Type":"ContainerStarted","Data":"4a13846d995b0d9bc428435128adc45a224f921dd61db9bd3d956bd781cd87d9"}
Sep 08 00:03:01.948512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:01.948432    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wcfkf" podStartSLOduration=3.337328447 podStartE2EDuration="22.948415555s" totalImagesPullingTime="19.611087108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:01.947728174 +0000 UTC m=+24.698425019" watchObservedRunningTime="2026-09-08 00:03:01.948415555 +0000 UTC m=+24.699112400"
Sep 08 00:03:02.768089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:02.768004    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:02.768246 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:02.768121    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:02.941983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:02.941844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"0ae90bd43c239f7e8ada9d3977bffcb2a169591f618e4278cc66a162e5294427"}
Sep 08 00:03:02.945119 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:02.945080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct" event={"ID":"27ab1a5e-4165-4744-9a4f-4f8c563e4769","Type":"ContainerStarted","Data":"3878e507709447c269e2841d21e27aa3b1c4c12c79d5f36b2798d6a1c25085d7"}
Sep 08 00:03:02.961140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:02.961075    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lcrct" podStartSLOduration=2.804677248 podStartE2EDuration="24.961051267s" totalImagesPullingTime="22.156374019s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:02.960371807 +0000 UTC m=+25.711068643" watchObservedRunningTime="2026-09-08 00:03:02.961051267 +0000 UTC m=+25.711748106"
Sep 08 00:03:03.330416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.330378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:03:03.331526 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.331508    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:03:03.767512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.767479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:03.767512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.767420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:03.767780 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:03.767625    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:03.768083 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:03.768044    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:03.947938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.947904    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:03:03.948357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:03.948324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-frm6j"
Sep 08 00:03:04.768092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:04.768056    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:04.768265 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:04.768184    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:05.767382 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.767209    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:05.767776 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.767229    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:05.767776 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:05.767508    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:05.767776 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:05.767611    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:05.955872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.955833    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" event={"ID":"d61c1ca6-b93c-4c9a-bb2f-0023316bd7ad","Type":"ContainerStarted","Data":"e31c905fcfd2e8caf41be7e7020188d88a4fed092eaa4f002916fd754412daa5"}
Sep 08 00:03:05.956115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.956091    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:05.956256 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.956155    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:05.956256 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.956198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:05.957914 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.957888    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="df3256f08d2a6afd7b94e00db879049e83bd906951b5d7bda6dc68a9ecf609e5" exitCode=0
Sep 08 00:03:05.958039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.957972    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"df3256f08d2a6afd7b94e00db879049e83bd906951b5d7bda6dc68a9ecf609e5"}
Sep 08 00:03:05.972671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.972645    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:05.972817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.972757    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:05.978232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:05.978185    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws" podStartSLOduration=7.293661334 podStartE2EDuration="26.978170816s" totalImagesPullingTime="19.684509482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:05.978138271 +0000 UTC m=+28.728835115" watchObservedRunningTime="2026-09-08 00:03:05.978170816 +0000 UTC m=+28.728867654"
Sep 08 00:03:06.767802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:06.767769    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:06.768383 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:06.767896    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:06.963388 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:06.963350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerStarted","Data":"b0a7fe2e94ac447c4eb786ec96b95e9ea8631fbf59436a0fba620d43453ebd3e"}
Sep 08 00:03:07.449551 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.449515    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vz4z5"]
Sep 08 00:03:07.449724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.449664    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:07.449796 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:07.449772    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:07.452436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.452403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kl7st"]
Sep 08 00:03:07.452613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.452560    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:07.452704 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:07.452680    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:07.453127 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.453105    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqdnr"]
Sep 08 00:03:07.453242 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.453200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:07.453320 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:07.453294    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:07.970943 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.970907    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="b0a7fe2e94ac447c4eb786ec96b95e9ea8631fbf59436a0fba620d43453ebd3e" exitCode=0
Sep 08 00:03:07.971446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:07.970989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"b0a7fe2e94ac447c4eb786ec96b95e9ea8631fbf59436a0fba620d43453ebd3e"}
Sep 08 00:03:08.767720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:08.767501    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:08.767851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:08.767530    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:08.767851 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:08.767838    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:08.767951 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:08.767911    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:08.976264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:08.976219    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="e10b8d8de1687ec8f50714beb3009219c4eed7b96e29fd07a5ece09b6f1db419" exitCode=0
Sep 08 00:03:08.976767 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:08.976277    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"e10b8d8de1687ec8f50714beb3009219c4eed7b96e29fd07a5ece09b6f1db419"}
Sep 08 00:03:09.767266 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:09.767227    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:09.767478 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:09.767361    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:10.767881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:10.767838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:10.768345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:10.767891    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:10.768345 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:10.767979    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-fqdnr" podUID="2752e920-cf27-424c-9b2b-d9b3afc22e4a"
Sep 08 00:03:10.768345 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:10.768108    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-vz4z5" podUID="771a2276-e098-496d-adef-c937a913a59f"
Sep 08 00:03:11.443770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:11.443715    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:11.443963 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.443840    2580 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:03:11.443963 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.443907    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs podName:0d159f5c-f279-48c1-affe-777c263a95e2 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:43.443888277 +0000 UTC m=+66.194585112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs") pod "network-metrics-daemon-kl7st" (UID: "0d159f5c-f279-48c1-affe-777c263a95e2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 00:03:11.544046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:11.544003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:11.544075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544158    2580 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544186    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544202    2580 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544215    2580 projected.go:196] Error preparing data for projected volume kube-api-access-fz229 for pod openshift-network-diagnostics/network-check-target-fqdnr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:03:11.544241 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544230    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret podName:771a2276-e098-496d-adef-c937a913a59f nodeName:}" failed. No retries permitted until 2026-09-08 00:03:43.544210564 +0000 UTC m=+66.294907406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret") pod "global-pull-secret-syncer-vz4z5" (UID: "771a2276-e098-496d-adef-c937a913a59f") : object "kube-system"/"original-pull-secret" not registered
Sep 08 00:03:11.544574 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.544278    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229 podName:2752e920-cf27-424c-9b2b-d9b3afc22e4a nodeName:}" failed. No retries permitted until 2026-09-08 00:03:43.544268385 +0000 UTC m=+66.294965223 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fz229" (UniqueName: "kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229") pod "network-check-target-fqdnr" (UID: "2752e920-cf27-424c-9b2b-d9b3afc22e4a") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 00:03:11.767925 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:11.767886    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:11.768437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:11.768040    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-kl7st" podUID="0d159f5c-f279-48c1-affe-777c263a95e2"
Sep 08 00:03:12.560953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.560920    2580 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-226.ec2.internal" event="NodeReady"
Sep 08 00:03:12.561176 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.561091    2580 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 00:03:12.591252 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.591205    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:03:12.626817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.626780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"]
Sep 08 00:03:12.627008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.626926    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.631065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.631035    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 00:03:12.636003 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.635971    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 00:03:12.636152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.636068    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hwm5h\""
Sep 08 00:03:12.636961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.636938    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 00:03:12.638042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.638017    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 00:03:12.642340 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.640995    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-pruner-29813760-gjbvs"]
Sep 08 00:03:12.642340 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.641290    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"
Sep 08 00:03:12.644540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.644368    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.645754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.645612    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.645754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.645631    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-qkk46\""
Sep 08 00:03:12.658747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.658716    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c9gh5"]
Sep 08 00:03:12.658906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.658849    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.661017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.660991    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"pruner-dockercfg-kjjzm\""
Sep 08 00:03:12.661285 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.661266    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"serviceca\""
Sep 08 00:03:12.674990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.674947    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"]
Sep 08 00:03:12.675183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.675030    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.677429 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.677362    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 08 00:03:12.677429 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.677425    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6jljx\""
Sep 08 00:03:12.677686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.677432    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 08 00:03:12.695043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695011    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"]
Sep 08 00:03:12.695043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29813760-gjbvs"]
Sep 08 00:03:12.695232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695067    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c9gh5"]
Sep 08 00:03:12.695232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695082    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:03:12.695232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695103    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-mr28b"]
Sep 08 00:03:12.695232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.695128    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.697736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.697467    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 00:03:12.697736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.697510    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.697736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.697534    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 00:03:12.697736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.697581    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pcb89\""
Sep 08 00:03:12.697736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.697668    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.719065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.719030    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"]
Sep 08 00:03:12.719218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.719160    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.721446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.721418    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 08 00:03:12.721610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.721466    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 08 00:03:12.721610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.721514    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vl7ff\""
Sep 08 00:03:12.721728 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.721671    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.721778 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.721748    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.728445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.728416    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 08 00:03:12.739272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.739238    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"]
Sep 08 00:03:12.739424 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.739346    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.741629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.741567    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 00:03:12.741629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.741576    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.741629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.741620    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.741930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.741889    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pdh67\""
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752045    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752145    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pw8q\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752168    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752257    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a0e09e75-5706-4815-9b0a-1fde1ae647fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752301    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.752357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752343    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752369    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkgvk\" (UniqueName: \"kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.752879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.752879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jdr\" (UniqueName: \"kubernetes.io/projected/45f25373-dfbf-41b2-bedb-a6c4a929bfdd-kube-api-access-w5jdr\") pod \"volume-data-source-validator-695c895bd6-jgjbm\" (UID: \"45f25373-dfbf-41b2-bedb-a6c4a929bfdd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"
Sep 08 00:03:12.752879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.752489    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.759319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.759286    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z5mrt"]
Sep 08 00:03:12.759477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.759420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.761614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.761544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 00:03:12.761766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.761741    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-44vqw\""
Sep 08 00:03:12.761903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.761786    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 00:03:12.761903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.761786    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.762045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.762024    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.785485 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.785433    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"]
Sep 08 00:03:12.785945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.785559    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:12.785945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.785595    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.785945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.785895    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:12.788011 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.787988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 00:03:12.788152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788069    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sgbhs\""
Sep 08 00:03:12.788152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788083    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 00:03:12.788265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788250    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xbmqx\""
Sep 08 00:03:12.788395 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788375    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.788496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788408    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 00:03:12.788496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.788467    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.801511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.801488    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7f4ff449fb-rc7hw"]
Sep 08 00:03:12.801755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.801737    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:12.803931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.803910    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.804040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.803914    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 08 00:03:12.804040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.804013    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6spgz\""
Sep 08 00:03:12.805162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.805140    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.805411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.805396    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 08 00:03:12.819565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.819538    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fbcft"]
Sep 08 00:03:12.819721 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.819704    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.821933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.821897    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 08 00:03:12.821933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.821928    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 08 00:03:12.822117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.821908    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g5wvx\""
Sep 08 00:03:12.822400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.822239    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.822400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.822252    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 08 00:03:12.822400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.822291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.822686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.822519    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 08 00:03:12.839854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.839814    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjbjw"]
Sep 08 00:03:12.840008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.839960    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.842212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.842183    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 00:03:12.842687 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.842660    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.842799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.842710    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 00:03:12.842799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.842776    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.843057 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.843037    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-m7tkb\""
Sep 08 00:03:12.850829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.850729    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 00:03:12.852969 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.852940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn7q5\" (UniqueName: \"kubernetes.io/projected/6b5d135d-83c8-46e4-97c4-c0078d034bda-kube-api-access-qn7q5\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.853076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.852979    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b7934f1-8ce1-475e-8524-f790689d0867-tmp-dir\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.853076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853009    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d447b60-336e-40e2-bb30-6d486427c4eb-serving-cert\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.853076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853032    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfghh\" (UniqueName: \"kubernetes.io/projected/5b7934f1-8ce1-475e-8524-f790689d0867-kube-api-access-jfghh\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.853076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853057    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853086    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd61e51b-6dc4-4462-8bbc-3858f532c644-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853111    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwcsr\" (UniqueName: \"kubernetes.io/projected/cd61e51b-6dc4-4462-8bbc-3858f532c644-kube-api-access-dwcsr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853164    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853252    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853279    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fkks\" (UniqueName: \"kubernetes.io/projected/0327a736-a2fc-429e-a328-f00d3b243f42-kube-api-access-7fkks\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.853368    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.853386    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.853441    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.353421047 +0000 UTC m=+36.104117885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.853490    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.853576    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.353558576 +0000 UTC m=+36.104255406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:12.853589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853370    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a0e09e75-5706-4815-9b0a-1fde1ae647fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-trusted-ca\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853682    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkgvk\" (UniqueName: \"kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853854    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0327a736-a2fc-429e-a328-f00d3b243f42-serving-cert\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.853986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.853922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jdr\" (UniqueName: \"kubernetes.io/projected/45f25373-dfbf-41b2-bedb-a6c4a929bfdd-kube-api-access-w5jdr\") pod \"volume-data-source-validator-695c895bd6-jgjbm\" (UID: \"45f25373-dfbf-41b2-bedb-a6c4a929bfdd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854069    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a0e09e75-5706-4815-9b0a-1fde1ae647fd-nginx-conf\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854134    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854186    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854225    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pw8q\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d447b60-336e-40e2-bb30-6d486427c4eb-config\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7934f1-8ce1-475e-8524-f790689d0867-config-volume\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854315    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854339    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-config\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.854409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854365    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd61e51b-6dc4-4462-8bbc-3858f532c644-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.854902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854661    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttg86\" (UniqueName: \"kubernetes.io/projected/5d447b60-336e-40e2-bb30-6d486427c4eb-kube-api-access-ttg86\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.854902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854691    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.854902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854748    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.854902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.854890    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-chcmx"]
Sep 08 00:03:12.855065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.855009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw"
Sep 08 00:03:12.857140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.857117    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-xvcpk\""
Sep 08 00:03:12.858497 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.858473    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.858614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.858474    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.871744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.871676    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.871744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.871702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkgvk\" (UniqueName: \"kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk\") pod \"image-pruner-29813760-gjbvs\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") " pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.871744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.871677    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pw8q\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:12.872044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.872025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jdr\" (UniqueName: \"kubernetes.io/projected/45f25373-dfbf-41b2-bedb-a6c4a929bfdd-kube-api-access-w5jdr\") pod \"volume-data-source-validator-695c895bd6-jgjbm\" (UID: \"45f25373-dfbf-41b2-bedb-a6c4a929bfdd\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"
Sep 08 00:03:12.892292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892254    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"]
Sep 08 00:03:12.892480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892304    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjbjw"]
Sep 08 00:03:12.892480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892329    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-mr28b"]
Sep 08 00:03:12.892480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892429    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:12.892480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892463    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892493    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fbcft"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892521    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892543    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4ff449fb-rc7hw"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892562    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892590    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chcmx"]
Sep 08 00:03:12.892676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.892604    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5mrt"]
Sep 08 00:03:12.894767 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.894688    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 00:03:12.894900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.894789    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 00:03:12.895026 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.895006    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9vvpw\""
Sep 08 00:03:12.895415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.895393    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 00:03:12.955094 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-trusted-ca\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg7bk\" (UniqueName: \"kubernetes.io/projected/97b21b46-0b12-49ce-855d-9a41aa30eca6-kube-api-access-gg7bk\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0327a736-a2fc-429e-a328-f00d3b243f42-serving-cert\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-stats-auth\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955207    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955227    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:12.955291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955253    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-default-certificate\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.955324    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955387    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.955399    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.45537699 +0000 UTC m=+36.206073817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955432    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955485    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d447b60-336e-40e2-bb30-6d486427c4eb-config\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955547    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2sfj\" (UniqueName: \"kubernetes.io/projected/bfc30e7b-5f79-4ecc-ab3f-fae8890abe60-kube-api-access-z2sfj\") pod \"network-check-source-685456655f-pjbjw\" (UID: \"bfc30e7b-5f79-4ecc-ab3f-fae8890abe60\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955572    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-tmp\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955599    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7934f1-8ce1-475e-8524-f790689d0867-config-volume\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.955634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955627    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-config\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.956148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd61e51b-6dc4-4462-8bbc-3858f532c644-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.956148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttg86\" (UniqueName: \"kubernetes.io/projected/5d447b60-336e-40e2-bb30-6d486427c4eb-kube-api-access-ttg86\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.956148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955735    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97b21b46-0b12-49ce-855d-9a41aa30eca6-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:12.956148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.955809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-serving-cert\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.956350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5d447b60-336e-40e2-bb30-6d486427c4eb-config\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.956350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956304    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-trusted-ca\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.956350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956313    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/cd61e51b-6dc4-4462-8bbc-3858f532c644-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.956350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956339    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn7q5\" (UniqueName: \"kubernetes.io/projected/6b5d135d-83c8-46e4-97c4-c0078d034bda-kube-api-access-qn7q5\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956366    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b7934f1-8ce1-475e-8524-f790689d0867-tmp-dir\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956392    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm9hd\" (UniqueName: \"kubernetes.io/projected/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-kube-api-access-qm9hd\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956417    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-snapshots\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956423    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5b7934f1-8ce1-475e-8524-f790689d0867-config-volume\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0327a736-a2fc-429e-a328-f00d3b243f42-config\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956486    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d447b60-336e-40e2-bb30-6d486427c4eb-serving-cert\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.956556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfghh\" (UniqueName: \"kubernetes.io/projected/5b7934f1-8ce1-475e-8524-f790689d0867-kube-api-access-jfghh\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956641    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbqlb\" (UniqueName: \"kubernetes.io/projected/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-kube-api-access-dbqlb\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956681    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5b7934f1-8ce1-475e-8524-f790689d0867-tmp-dir\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.956739    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956748    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd61e51b-6dc4-4462-8bbc-3858f532c644-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:12.956790    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.456773846 +0000 UTC m=+36.207470679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:12.956859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956812    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwcsr\" (UniqueName: \"kubernetes.io/projected/cd61e51b-6dc4-4462-8bbc-3858f532c644-kube-api-access-dwcsr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.957152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.956907    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7fkks\" (UniqueName: \"kubernetes.io/projected/0327a736-a2fc-429e-a328-f00d3b243f42-kube-api-access-7fkks\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.958469 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.958433    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0327a736-a2fc-429e-a328-f00d3b243f42-serving-cert\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.959136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.959098    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/cd61e51b-6dc4-4462-8bbc-3858f532c644-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.964384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.964325    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttg86\" (UniqueName: \"kubernetes.io/projected/5d447b60-336e-40e2-bb30-6d486427c4eb-kube-api-access-ttg86\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:12.965380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.965345    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fkks\" (UniqueName: \"kubernetes.io/projected/0327a736-a2fc-429e-a328-f00d3b243f42-kube-api-access-7fkks\") pod \"console-operator-85b454874b-mr28b\" (UID: \"0327a736-a2fc-429e-a328-f00d3b243f42\") " pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:12.966347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.966321    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfghh\" (UniqueName: \"kubernetes.io/projected/5b7934f1-8ce1-475e-8524-f790689d0867-kube-api-access-jfghh\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:12.966469 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.966383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwcsr\" (UniqueName: \"kubernetes.io/projected/cd61e51b-6dc4-4462-8bbc-3858f532c644-kube-api-access-dwcsr\") pod \"kube-storage-version-migrator-operator-8d7dd4675-vmwv9\" (UID: \"cd61e51b-6dc4-4462-8bbc-3858f532c644\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:12.967438 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.967413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn7q5\" (UniqueName: \"kubernetes.io/projected/6b5d135d-83c8-46e4-97c4-c0078d034bda-kube-api-access-qn7q5\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:12.969205 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.969159    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:03:12.971904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:12.971884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5d447b60-336e-40e2-bb30-6d486427c4eb-serving-cert\") pod \"service-ca-operator-859f94c4b-vkxj9\" (UID: \"5d447b60-336e-40e2-bb30-6d486427c4eb\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:13.006810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.006776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"
Sep 08 00:03:13.032063 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.031834    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:13.058380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058345    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtc8x\" (UniqueName: \"kubernetes.io/projected/8b7202f7-5128-4cca-8819-56c827353d89-kube-api-access-qtc8x\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.058565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg7bk\" (UniqueName: \"kubernetes.io/projected/97b21b46-0b12-49ce-855d-9a41aa30eca6-kube-api-access-gg7bk\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.058565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058488    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-stats-auth\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.058565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.058738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058564    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.058738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058588    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-default-certificate\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.058738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058609    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.058738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.058738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058664    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2sfj\" (UniqueName: \"kubernetes.io/projected/bfc30e7b-5f79-4ecc-ab3f-fae8890abe60-kube-api-access-z2sfj\") pod \"network-check-source-685456655f-pjbjw\" (UID: \"bfc30e7b-5f79-4ecc-ab3f-fae8890abe60\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw"
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.058847    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.558824283 +0000 UTC m=+36.309521129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058882    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-tmp\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97b21b46-0b12-49ce-855d-9a41aa30eca6-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058938    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-serving-cert\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.058971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm9hd\" (UniqueName: \"kubernetes.io/projected/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-kube-api-access-qm9hd\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.058985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-snapshots\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059003    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b7202f7-5128-4cca-8819-56c827353d89-cert\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbqlb\" (UniqueName: \"kubernetes.io/projected/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-kube-api-access-dbqlb\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.059149    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.059206    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:13.059246 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.059236    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.559217678 +0000 UTC m=+36.309914507 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:13.059554 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.059257    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:13.559247219 +0000 UTC m=+36.309944042 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:13.059554 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059346    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059669 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059619    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-tmp\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059875    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-snapshots\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.059995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.059982    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/97b21b46-0b12-49ce-855d-9a41aa30eca6-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.061992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.061966    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-serving-cert\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.062152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.062132    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-stats-auth\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.062301 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.062275    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-default-certificate\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.069704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.069629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"
Sep 08 00:03:13.069853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.069770    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2sfj\" (UniqueName: \"kubernetes.io/projected/bfc30e7b-5f79-4ecc-ab3f-fae8890abe60-kube-api-access-z2sfj\") pod \"network-check-source-685456655f-pjbjw\" (UID: \"bfc30e7b-5f79-4ecc-ab3f-fae8890abe60\") " pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw"
Sep 08 00:03:13.069915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.069866    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm9hd\" (UniqueName: \"kubernetes.io/projected/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-kube-api-access-qm9hd\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.070093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.070057    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg7bk\" (UniqueName: \"kubernetes.io/projected/97b21b46-0b12-49ce-855d-9a41aa30eca6-kube-api-access-gg7bk\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.070093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.070079    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbqlb\" (UniqueName: \"kubernetes.io/projected/9c79ec42-bd9b-47ef-a35b-a75046a2d94f-kube-api-access-dbqlb\") pod \"insights-operator-76bcd6ccf5-fbcft\" (UID: \"9c79ec42-bd9b-47ef-a35b-a75046a2d94f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.153488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.153438    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft"
Sep 08 00:03:13.159854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.159818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtc8x\" (UniqueName: \"kubernetes.io/projected/8b7202f7-5128-4cca-8819-56c827353d89-kube-api-access-qtc8x\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.160016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.159966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b7202f7-5128-4cca-8819-56c827353d89-cert\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.162561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.162536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8b7202f7-5128-4cca-8819-56c827353d89-cert\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.167186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.167161    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtc8x\" (UniqueName: \"kubernetes.io/projected/8b7202f7-5128-4cca-8819-56c827353d89-kube-api-access-qtc8x\") pod \"ingress-canary-chcmx\" (UID: \"8b7202f7-5128-4cca-8819-56c827353d89\") " pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.186286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.186250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw"
Sep 08 00:03:13.203625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.203577    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-chcmx"
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.364328    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.364604    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.364663    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.364742    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.364715889 +0000 UTC m=+37.115412807 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.364856    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.365051    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:13.365185 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.365110    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.365094153 +0000 UTC m=+37.115790992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:13.466386 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.466349    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:13.466583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.466511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:13.466839 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.466687    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.466839 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.466760    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.466740573 +0000 UTC m=+37.217437412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:13.467336 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.467207    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:13.467336 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.467265    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.46724991 +0000 UTC m=+37.217946737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:13.567164 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.567126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:13.567352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.567172    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.567352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.567206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:13.567352 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.567289    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:13.567352 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.567325    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.567299207 +0000 UTC m=+37.317996043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:13.567556 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.567359    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.567342267 +0000 UTC m=+37.318039107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:13.567556 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.567371    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:13.567556 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:13.567420    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:14.567407092 +0000 UTC m=+37.318103914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:13.647927 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.646912    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-pjbjw"]
Sep 08 00:03:13.651564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.651486    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9"]
Sep 08 00:03:13.653820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.653790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-chcmx"]
Sep 08 00:03:13.655843 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:13.655812    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc30e7b_5f79_4ecc_ab3f_fae8890abe60.slice/crio-707c635e572bd04449e1232a2b09d27c0afe6ec7aa8a515fd17f62b3996458a2 WatchSource:0}: Error finding container 707c635e572bd04449e1232a2b09d27c0afe6ec7aa8a515fd17f62b3996458a2: Status 404 returned error can't find the container with id 707c635e572bd04449e1232a2b09d27c0afe6ec7aa8a515fd17f62b3996458a2
Sep 08 00:03:13.657192 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:13.657159    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d447b60_336e_40e2_bb30_6d486427c4eb.slice/crio-1efdbb7929d3aa5b053aa71bf00320e1e1e0c1139762be9ad2c6971105e586db WatchSource:0}: Error finding container 1efdbb7929d3aa5b053aa71bf00320e1e1e0c1139762be9ad2c6971105e586db: Status 404 returned error can't find the container with id 1efdbb7929d3aa5b053aa71bf00320e1e1e0c1139762be9ad2c6971105e586db
Sep 08 00:03:13.657805 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:13.657778    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7202f7_5128_4cca_8819_56c827353d89.slice/crio-d4e8ed67388990a7a6a255ee4f2e5c9494adaaa975968f003686234599a02d69 WatchSource:0}: Error finding container d4e8ed67388990a7a6a255ee4f2e5c9494adaaa975968f003686234599a02d69: Status 404 returned error can't find the container with id d4e8ed67388990a7a6a255ee4f2e5c9494adaaa975968f003686234599a02d69
Sep 08 00:03:13.661119 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.661058    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm"]
Sep 08 00:03:13.664693 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.664640    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-pruner-29813760-gjbvs"]
Sep 08 00:03:13.664693 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:13.664663    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45f25373_dfbf_41b2_bedb_a6c4a929bfdd.slice/crio-af054428f5add727ddeaaa17b6f47b6f695d55f59b1473b1a5dc6f61f412df58 WatchSource:0}: Error finding container af054428f5add727ddeaaa17b6f47b6f695d55f59b1473b1a5dc6f61f412df58: Status 404 returned error can't find the container with id af054428f5add727ddeaaa17b6f47b6f695d55f59b1473b1a5dc6f61f412df58
Sep 08 00:03:13.669930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.667931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9"]
Sep 08 00:03:13.669930 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:13.668674    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod025ffe90_b36a_460d_88d5_7c9fd0dd0153.slice/crio-2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493 WatchSource:0}: Error finding container 2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493: Status 404 returned error can't find the container with id 2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493
Sep 08 00:03:13.670863 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.670841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-mr28b"]
Sep 08 00:03:13.671855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.671832    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-fbcft"]
Sep 08 00:03:13.767194 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.767156    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:13.769471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.769437    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 00:03:13.769587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.769508    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7g2f\""
Sep 08 00:03:13.989850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.989814    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29813760-gjbvs" event={"ID":"025ffe90-b36a-460d-88d5-7c9fd0dd0153","Type":"ContainerStarted","Data":"d7a453dd2c1d4fc46656debaf3d9499a66543ffe289e65200d9a47adf7c95b22"}
Sep 08 00:03:13.990647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.989875    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29813760-gjbvs" event={"ID":"025ffe90-b36a-460d-88d5-7c9fd0dd0153","Type":"ContainerStarted","Data":"2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493"}
Sep 08 00:03:13.991146 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.991123    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm" event={"ID":"45f25373-dfbf-41b2-bedb-a6c4a929bfdd","Type":"ContainerStarted","Data":"af054428f5add727ddeaaa17b6f47b6f695d55f59b1473b1a5dc6f61f412df58"}
Sep 08 00:03:13.992183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.992162    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chcmx" event={"ID":"8b7202f7-5128-4cca-8819-56c827353d89","Type":"ContainerStarted","Data":"d4e8ed67388990a7a6a255ee4f2e5c9494adaaa975968f003686234599a02d69"}
Sep 08 00:03:13.993296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.993274    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw" event={"ID":"bfc30e7b-5f79-4ecc-ab3f-fae8890abe60","Type":"ContainerStarted","Data":"707c635e572bd04449e1232a2b09d27c0afe6ec7aa8a515fd17f62b3996458a2"}
Sep 08 00:03:13.994338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.994317    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9" event={"ID":"5d447b60-336e-40e2-bb30-6d486427c4eb","Type":"ContainerStarted","Data":"1efdbb7929d3aa5b053aa71bf00320e1e1e0c1139762be9ad2c6971105e586db"}
Sep 08 00:03:13.996918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.996895    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="26401343a14baa073e18f0a06d2612ed69bc9e2c22c0df34204c27784ad63e62" exitCode=0
Sep 08 00:03:13.997006 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.996957    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"26401343a14baa073e18f0a06d2612ed69bc9e2c22c0df34204c27784ad63e62"}
Sep 08 00:03:13.998189 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.998152    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft" event={"ID":"9c79ec42-bd9b-47ef-a35b-a75046a2d94f","Type":"ContainerStarted","Data":"868b39a935bb8d7ad44ed03a506561843e360fb6f7989d9971e0f98024b83f0a"}
Sep 08 00:03:13.999296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:13.999276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9" event={"ID":"cd61e51b-6dc4-4462-8bbc-3858f532c644","Type":"ContainerStarted","Data":"256e0dd668ab59b79b6e506c539fac05b3ee7d551ff8dd556f3270079a34d496"}
Sep 08 00:03:14.000370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.000350    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-mr28b" event={"ID":"0327a736-a2fc-429e-a328-f00d3b243f42","Type":"ContainerStarted","Data":"5d3a81c85f6c5fbc1632fad5b89c283d4da674433c8ac374401dd4cc92b30412"}
Sep 08 00:03:14.003513 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.003427    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-pruner-29813760-gjbvs" podStartSLOduration=194.003414025 podStartE2EDuration="3m14.003414025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:14.002537753 +0000 UTC m=+36.753234642" watchObservedRunningTime="2026-09-08 00:03:14.003414025 +0000 UTC m=+36.754110891"
Sep 08 00:03:14.375070 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.375032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:14.375070 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.375073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:14.375315 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.375196    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:14.375315 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.375207    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:14.375315 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.375233    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:14.375315 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.375265    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.375247311 +0000 UTC m=+39.125944153 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:14.375483 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.375380    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.375361138 +0000 UTC m=+39.126057972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:14.475902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.475850    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:14.476082 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.475969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:14.476082 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.476014    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:14.476198 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.476094    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.476072409 +0000 UTC m=+39.226769235 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:14.476198 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.476126    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:14.476198 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.476184    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.476167756 +0000 UTC m=+39.226864584 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:14.577157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.577115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:14.577321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.577174    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:14.577321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:14.577216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:14.577467 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.577434    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:14.577545 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.577526    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.577505141 +0000 UTC m=+39.328201969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:14.577975 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.577946    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:14.578070 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.577998    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.577982596 +0000 UTC m=+39.328679421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:14.578070 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:14.578066    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:16.578055981 +0000 UTC m=+39.328752805 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:15.016424 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:15.015579    2580 generic.go:356] "Generic (PLEG): container finished" podID="51e6f0fc-b698-458b-8f48-6fc70bbd19f3" containerID="ed59995570b205ae6a2817650d12a445cffa1392c669ad8a0646126c377e0ea7" exitCode=0
Sep 08 00:03:15.017114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:15.016997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerDied","Data":"ed59995570b205ae6a2817650d12a445cffa1392c669ad8a0646126c377e0ea7"}
Sep 08 00:03:16.027395 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.026590    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" event={"ID":"51e6f0fc-b698-458b-8f48-6fc70bbd19f3","Type":"ContainerStarted","Data":"b365432beff5f8493e2c7cf225baa8127e008421f68da24220a2a0550bb6a3c6"}
Sep 08 00:03:16.029294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.029263    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm" event={"ID":"45f25373-dfbf-41b2-bedb-a6c4a929bfdd","Type":"ContainerStarted","Data":"ae8e0b674e5663925e799cc3bec9465794a7745ebf66774d191f1fbfd74f65e8"}
Sep 08 00:03:16.062488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.062047    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-jzp4x" podStartSLOduration=10.389838224 podStartE2EDuration="37.062021159s" totalImagesPullingTime="26.672182935s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:16.047483971 +0000 UTC m=+38.798180815" watchObservedRunningTime="2026-09-08 00:03:16.062021159 +0000 UTC m=+38.812718005"
Sep 08 00:03:16.399504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.399399    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:16.399665 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.399591    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:16.399665 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.399610    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:16.399846 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.399673    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.399652725 +0000 UTC m=+43.150349560 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:16.399846 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.399704    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:16.399846 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.399782    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.399764465 +0000 UTC m=+43.150461292 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:16.400085 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.399467    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:16.501231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.501188    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:16.501405 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.501320    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:16.501551 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.501530    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:16.501616 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.501593    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.501574472 +0000 UTC m=+43.252271297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:16.502004 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.501984    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:16.502081 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.502039    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.502024668 +0000 UTC m=+43.252721505 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:16.602155 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.602117    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:16.602335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.602175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:16.602335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:16.602215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:16.602335 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.602301    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:16.602479 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.602380    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.602358705 +0000 UTC m=+43.353055542 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:16.602479 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.602379    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:16.602479 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.602420    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.602409042 +0000 UTC m=+43.353105869 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:16.602479 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:16.602447    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:20.602430598 +0000 UTC m=+43.353127420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:20.435858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.435817    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:20.435858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.435862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:20.436308 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.435974    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:20.436308 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.435997    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:20.436308 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.436055    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:20.436308 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.436065    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.436043796 +0000 UTC m=+51.186740651 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:20.436308 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.436110    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.436097256 +0000 UTC m=+51.186794078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:20.536882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.536840    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:20.537066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.536972    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:20.537066 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.537013    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:20.537170 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.537096    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.537077528 +0000 UTC m=+51.287774350 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:20.537170 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.537111    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:20.537170 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.537166    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.537149983 +0000 UTC m=+51.287846806 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:20.638103 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.638064    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:20.638262 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.638115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:20.638262 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:20.638235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:20.638393 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.638254    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.638234856 +0000 UTC m=+51.388931702 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:20.638393 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.638296    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:20.638393 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.638360    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.638343627 +0000 UTC m=+51.389040467 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:20.638393 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.638300    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:20.638570 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:20.638434    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:28.638421257 +0000 UTC m=+51.389118095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:22.051499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.051443    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw" event={"ID":"bfc30e7b-5f79-4ecc-ab3f-fae8890abe60","Type":"ContainerStarted","Data":"fd41b72934595ae9de8481b12e789899e29fef59847f249926ed20cffe57bbc3"}
Sep 08 00:03:22.053579 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.053487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9" event={"ID":"5d447b60-336e-40e2-bb30-6d486427c4eb","Type":"ContainerStarted","Data":"ad3981cd4ff25a0ceef9a43eefb79e7000c00cdde6912a37e79c6c88d63a42c8"}
Sep 08 00:03:22.055376 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.055353    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft" event={"ID":"9c79ec42-bd9b-47ef-a35b-a75046a2d94f","Type":"ContainerStarted","Data":"cdf903ccb886ff6f75570af0fcfa2d2fa822912612b4578832f60a3bf1fb4886"}
Sep 08 00:03:22.057082 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.057056    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9" event={"ID":"cd61e51b-6dc4-4462-8bbc-3858f532c644","Type":"ContainerStarted","Data":"476fdf31a4a1d8c6a50f2bca10369e969f28e8701c6e43b8e9528ac930f29f45"}
Sep 08 00:03:22.059062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.059038    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-chcmx" event={"ID":"8b7202f7-5128-4cca-8819-56c827353d89","Type":"ContainerStarted","Data":"2967aae8155c337c9196fcd170a603b8fa0baa068237b69270266872e5e4d773"}
Sep 08 00:03:22.065650 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.065600    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-jgjbm" podStartSLOduration=26.352509867 podStartE2EDuration="28.065581737s" totalImagesPullingTime="1.71307187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:16.062446976 +0000 UTC m=+38.813143822" watchObservedRunningTime="2026-09-08 00:03:22.065581737 +0000 UTC m=+44.816278585"
Sep 08 00:03:22.066888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.066848    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-pjbjw" podStartSLOduration=20.231144744 podStartE2EDuration="28.066832941s" totalImagesPullingTime="7.835688197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.06572732 +0000 UTC m=+44.816424147" watchObservedRunningTime="2026-09-08 00:03:22.066832941 +0000 UTC m=+44.817529786"
Sep 08 00:03:22.097544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.097470    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-chcmx" podStartSLOduration=2.263536191 podStartE2EDuration="10.097426792s" totalImagesPullingTime="7.833890601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.081590118 +0000 UTC m=+44.832286974" watchObservedRunningTime="2026-09-08 00:03:22.097426792 +0000 UTC m=+44.848123636"
Sep 08 00:03:22.116849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.116792    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9" podStartSLOduration=20.282889735 podStartE2EDuration="28.116771091s" totalImagesPullingTime="7.833881356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.098925253 +0000 UTC m=+44.849622098" watchObservedRunningTime="2026-09-08 00:03:22.116771091 +0000 UTC m=+44.867467937"
Sep 08 00:03:22.117801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.117760    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9" podStartSLOduration=20.303628373 podStartE2EDuration="28.11774667s" totalImagesPullingTime="7.814118297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.116472538 +0000 UTC m=+44.867169408" watchObservedRunningTime="2026-09-08 00:03:22.11774667 +0000 UTC m=+44.868443512"
Sep 08 00:03:22.131988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.131909    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft" podStartSLOduration=20.314509928 podStartE2EDuration="28.131886084s" totalImagesPullingTime="7.817376156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:22.131346182 +0000 UTC m=+44.882043025" watchObservedRunningTime="2026-09-08 00:03:22.131886084 +0000 UTC m=+44.882582929"
Sep 08 00:03:22.890896 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.890857    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nd8wc"]
Sep 08 00:03:22.913135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.913103    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nd8wc"]
Sep 08 00:03:22.913286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.913249    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:22.915595 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.915544    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 00:03:22.915595 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.915566    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8cwdj\""
Sep 08 00:03:22.915807 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:22.915667    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 00:03:23.062634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.062590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdwdr\" (UniqueName: \"kubernetes.io/projected/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-api-access-mdwdr\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.063100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.062737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-data-volume\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.063100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.062785    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.063100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.062899    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-crio-socket\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.063100 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.063034    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.065859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.065829    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/0.log"
Sep 08 00:03:23.066037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.065877    2580 generic.go:356] "Generic (PLEG): container finished" podID="0327a736-a2fc-429e-a328-f00d3b243f42" containerID="d610e96f65aef2aae25c47986b2b3563111c61de1ffcbcdbfecbc99e553fa9b7" exitCode=255
Sep 08 00:03:23.066037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.065961    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-mr28b" event={"ID":"0327a736-a2fc-429e-a328-f00d3b243f42","Type":"ContainerDied","Data":"d610e96f65aef2aae25c47986b2b3563111c61de1ffcbcdbfecbc99e553fa9b7"}
Sep 08 00:03:23.066222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.066193    2580 scope.go:117] "RemoveContainer" containerID="d610e96f65aef2aae25c47986b2b3563111c61de1ffcbcdbfecbc99e553fa9b7"
Sep 08 00:03:23.163903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.163724    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164073 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.163906    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdwdr\" (UniqueName: \"kubernetes.io/projected/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-api-access-mdwdr\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164073 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.164033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-data-volume\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.164120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164186 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.164146    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.164289 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.164228    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:23.664205489 +0000 UTC m=+46.414902328 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.164726 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.164403    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.164726 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.164491    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:23.66444734 +0000 UTC m=+46.415144180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.164726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.164612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-data-volume\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.164666    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-crio-socket\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.164970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.164815    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-crio-socket\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.175813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.175782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdwdr\" (UniqueName: \"kubernetes.io/projected/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-api-access-mdwdr\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.669720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.669675    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.669880 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.669836    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.669918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:23.669897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:23.669918 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.669905    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:24.669888693 +0000 UTC m=+47.420585519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:23.670218 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.669999    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:23.670218 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:23.670044    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:24.670032974 +0000 UTC m=+47.420729797 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:24.076675 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.076631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:03:24.077287 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.077263    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/0.log"
Sep 08 00:03:24.077346 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.077316    2580 generic.go:356] "Generic (PLEG): container finished" podID="0327a736-a2fc-429e-a328-f00d3b243f42" containerID="1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3" exitCode=255
Sep 08 00:03:24.077411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.077393    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-mr28b" event={"ID":"0327a736-a2fc-429e-a328-f00d3b243f42","Type":"ContainerDied","Data":"1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3"}
Sep 08 00:03:24.077529 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.077512    2580 scope.go:117] "RemoveContainer" containerID="d610e96f65aef2aae25c47986b2b3563111c61de1ffcbcdbfecbc99e553fa9b7"
Sep 08 00:03:24.077773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.077753    2580 scope.go:117] "RemoveContainer" containerID="1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3"
Sep 08 00:03:24.078012 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:24.077990    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-mr28b_openshift-console-operator(0327a736-a2fc-429e-a328-f00d3b243f42)\"" pod="openshift-console-operator/console-operator-85b454874b-mr28b" podUID="0327a736-a2fc-429e-a328-f00d3b243f42"
Sep 08 00:03:24.660191 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.660162    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdl9t_89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763/dns-node-resolver/0.log"
Sep 08 00:03:24.679784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.679745    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:24.679969 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.679843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:24.679969 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:24.679877    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:24.679969 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:24.679944    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:26.679927768 +0000 UTC m=+49.430624590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:24.679969 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:24.679947    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:24.680116 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:24.679988    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:26.679976962 +0000 UTC m=+49.430673798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:24.860167 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:24.860137    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29813760-gjbvs_025ffe90-b36a-460d-88d5-7c9fd0dd0153/image-pruner/0.log"
Sep 08 00:03:25.082014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:25.081984    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:03:25.082389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:25.082369    2580 scope.go:117] "RemoveContainer" containerID="1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3"
Sep 08 00:03:25.082582 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:25.082562    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-mr28b_openshift-console-operator(0327a736-a2fc-429e-a328-f00d3b243f42)\"" pod="openshift-console-operator/console-operator-85b454874b-mr28b" podUID="0327a736-a2fc-429e-a328-f00d3b243f42"
Sep 08 00:03:25.459850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:25.459767    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bswq_7472943a-9a97-40dc-99b9-ed611eafe0a0/node-ca/0.log"
Sep 08 00:03:26.261047 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:26.260998    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chcmx_8b7202f7-5128-4cca-8819-56c827353d89/serve-healthcheck-canary/0.log"
Sep 08 00:03:26.698216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:26.698126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:26.698366 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:26.698295    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:26.698366 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:26.698342    2580 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 00:03:26.698366 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:26.698357    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:30.698342615 +0000 UTC m=+53.449039460 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:26.698520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:26.698295    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:26.698520 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:26.698384    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:30.698372072 +0000 UTC m=+53.449068894 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : configmap "kube-rbac-proxy" not found
Sep 08 00:03:28.520264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.520216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:28.520264 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.520265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:28.520781 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.520370    2580 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 08 00:03:28.520781 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.520375    2580 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 00:03:28.520781 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.520396    2580 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc48cd7b6-v87bb: secret "image-registry-tls" not found
Sep 08 00:03:28.520781 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.520428    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert podName:a0e09e75-5706-4815-9b0a-1fde1ae647fd nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.520412555 +0000 UTC m=+67.271109378 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-c9gh5" (UID: "a0e09e75-5706-4815-9b0a-1fde1ae647fd") : secret "networking-console-plugin-cert" not found
Sep 08 00:03:28.520781 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.520441    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls podName:429370e9-a846-489d-90f0-117f0970b16d nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.520435085 +0000 UTC m=+67.271131907 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls") pod "image-registry-fc48cd7b6-v87bb" (UID: "429370e9-a846-489d-90f0-117f0970b16d") : secret "image-registry-tls" not found
Sep 08 00:03:28.620961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.620920    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:28.621134 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.621017    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:28.621134 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.621079    2580 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 00:03:28.621210 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.621152    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls podName:6b5d135d-83c8-46e4-97c4-c0078d034bda nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.621133964 +0000 UTC m=+67.371830790 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-8slz4" (UID: "6b5d135d-83c8-46e4-97c4-c0078d034bda") : secret "samples-operator-tls" not found
Sep 08 00:03:28.621210 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.621160    2580 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 00:03:28.621278 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.621215    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls podName:5b7934f1-8ce1-475e-8524-f790689d0867 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.621199692 +0000 UTC m=+67.371896528 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls") pod "dns-default-z5mrt" (UID: "5b7934f1-8ce1-475e-8524-f790689d0867") : secret "dns-default-metrics-tls" not found
Sep 08 00:03:28.722215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.722176    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:28.722215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.722220    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:28.722245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.722331    2580 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.722353    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.722336246 +0000 UTC m=+67.473033068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : configmap references non-existent config key: service-ca.crt
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.722395    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls podName:97b21b46-0b12-49ce-855d-9a41aa30eca6 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.722379178 +0000 UTC m=+67.473076022 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hwb4w" (UID: "97b21b46-0b12-49ce-855d-9a41aa30eca6") : secret "cluster-monitoring-operator-tls" not found
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.722393    2580 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 08 00:03:28.722437 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:28.722426    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs podName:ba4d08ce-90e0-452c-b2cb-abf00f6edbd3 nodeName:}" failed. No retries permitted until 2026-09-08 00:03:44.722420171 +0000 UTC m=+67.473116997 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs") pod "router-default-7f4ff449fb-rc7hw" (UID: "ba4d08ce-90e0-452c-b2cb-abf00f6edbd3") : secret "router-metrics-certs-default" not found
Sep 08 00:03:30.738981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:30.738942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:30.739387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:30.739031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:30.739387 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:30.739126    2580 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:30.739387 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:30.739178    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls podName:d6d0b840-c1ac-4a67-8efe-a9b2aba631bc nodeName:}" failed. No retries permitted until 2026-09-08 00:03:38.739165206 +0000 UTC m=+61.489862028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nd8wc" (UID: "d6d0b840-c1ac-4a67-8efe-a9b2aba631bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 00:03:30.739554 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:30.739534    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:33.032418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:33.032372    2580 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:33.032912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:33.032438    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:33.032912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:33.032810    2580 scope.go:117] "RemoveContainer" containerID="1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3"
Sep 08 00:03:33.032990 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:03:33.032957    2580 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-mr28b_openshift-console-operator(0327a736-a2fc-429e-a328-f00d3b243f42)\"" pod="openshift-console-operator/console-operator-85b454874b-mr28b" podUID="0327a736-a2fc-429e-a328-f00d3b243f42"
Sep 08 00:03:37.982053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:37.982021    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-jf4ws"
Sep 08 00:03:38.812943 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:38.812892    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:38.815292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:38.815265    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d6d0b840-c1ac-4a67-8efe-a9b2aba631bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nd8wc\" (UID: \"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc\") " pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:38.827627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:38.827594    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8cwdj\""
Sep 08 00:03:38.835133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:38.835104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nd8wc"
Sep 08 00:03:39.104795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:39.104768    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nd8wc"]
Sep 08 00:03:39.107353 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:39.107325    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6d0b840_c1ac_4a67_8efe_a9b2aba631bc.slice/crio-a9117e80162e8e08fe430c05d30572cab359cc08adf05c61ecb52ffbb315709b WatchSource:0}: Error finding container a9117e80162e8e08fe430c05d30572cab359cc08adf05c61ecb52ffbb315709b: Status 404 returned error can't find the container with id a9117e80162e8e08fe430c05d30572cab359cc08adf05c61ecb52ffbb315709b
Sep 08 00:03:39.131872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:39.131844    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nd8wc" event={"ID":"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc","Type":"ContainerStarted","Data":"a9117e80162e8e08fe430c05d30572cab359cc08adf05c61ecb52ffbb315709b"}
Sep 08 00:03:40.139370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:40.139340    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nd8wc" event={"ID":"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc","Type":"ContainerStarted","Data":"9e478685f6808069e2dd34d9e9bf5ea44e0faac170f279d77fd9e419b9237893"}
Sep 08 00:03:41.145558 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:41.145512    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nd8wc" event={"ID":"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc","Type":"ContainerStarted","Data":"90fddcc9a38e2bb7bd8045dac9cc77f7589a2f040ec655b99abaec17b48cd07c"}
Sep 08 00:03:42.151699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:42.151609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nd8wc" event={"ID":"d6d0b840-c1ac-4a67-8efe-a9b2aba631bc","Type":"ContainerStarted","Data":"40dbe316f2d5ada4111524f09a69328dd793a43b2a6b8c777382aa6aee7c2d87"}
Sep 08 00:03:42.167101 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:42.167043    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nd8wc" podStartSLOduration=17.595868714 podStartE2EDuration="20.167024753s" totalImagesPullingTime="2.571156039s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:03:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:42.166320844 +0000 UTC m=+64.917017699" watchObservedRunningTime="2026-09-08 00:03:42.167024753 +0000 UTC m=+64.917721596"
Sep 08 00:03:43.454921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.454880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:43.457215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.457192    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 00:03:43.467999 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.467973    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d159f5c-f279-48c1-affe-777c263a95e2-metrics-certs\") pod \"network-metrics-daemon-kl7st\" (UID: \"0d159f5c-f279-48c1-affe-777c263a95e2\") " pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:43.480014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.479988    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-b7g2f\""
Sep 08 00:03:43.488514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.488473    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-kl7st"
Sep 08 00:03:43.556505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.556445    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:43.556687 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.556558    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:43.559105 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.559075    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 00:03:43.560074 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.560049    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fz229\" (UniqueName: \"kubernetes.io/projected/2752e920-cf27-424c-9b2b-d9b3afc22e4a-kube-api-access-fz229\") pod \"network-check-target-fqdnr\" (UID: \"2752e920-cf27-424c-9b2b-d9b3afc22e4a\") " pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:43.569872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.569839    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/771a2276-e098-496d-adef-c937a913a59f-original-pull-secret\") pod \"global-pull-secret-syncer-vz4z5\" (UID: \"771a2276-e098-496d-adef-c937a913a59f\") " pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:43.696892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.696838    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vz4z5"
Sep 08 00:03:43.715906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.715879    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sgbhs\""
Sep 08 00:03:43.723657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.723625    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:43.765397 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.764664    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-kl7st"]
Sep 08 00:03:43.786531 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:43.786498    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d159f5c_f279_48c1_affe_777c263a95e2.slice/crio-2a49e0f976c1c96e360627b1736db9a89d5a4337d14c56faf1420f6ac295a899 WatchSource:0}: Error finding container 2a49e0f976c1c96e360627b1736db9a89d5a4337d14c56faf1420f6ac295a899: Status 404 returned error can't find the container with id 2a49e0f976c1c96e360627b1736db9a89d5a4337d14c56faf1420f6ac295a899
Sep 08 00:03:43.978161 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:43.978133    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vz4z5"]
Sep 08 00:03:43.980475 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:43.980434    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod771a2276_e098_496d_adef_c937a913a59f.slice/crio-5f7ba60b3e3b5297af2ffc400e364c555b3ea97d1db202a1acaa955256d1021a WatchSource:0}: Error finding container 5f7ba60b3e3b5297af2ffc400e364c555b3ea97d1db202a1acaa955256d1021a: Status 404 returned error can't find the container with id 5f7ba60b3e3b5297af2ffc400e364c555b3ea97d1db202a1acaa955256d1021a
Sep 08 00:03:44.019488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.019438    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-fqdnr"]
Sep 08 00:03:44.022213 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:44.022181    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2752e920_cf27_424c_9b2b_d9b3afc22e4a.slice/crio-a3ffbe81adb514b527e9f7181c012f370d96a7a3ba627bd449f51f100befc218 WatchSource:0}: Error finding container a3ffbe81adb514b527e9f7181c012f370d96a7a3ba627bd449f51f100befc218: Status 404 returned error can't find the container with id a3ffbe81adb514b527e9f7181c012f370d96a7a3ba627bd449f51f100befc218
Sep 08 00:03:44.159859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.159818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqdnr" event={"ID":"2752e920-cf27-424c-9b2b-d9b3afc22e4a","Type":"ContainerStarted","Data":"fbb850d1b41f92eb040e29aa3944364d9b8aaa9408e0547249b481b412e364c8"}
Sep 08 00:03:44.160066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.159880    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-fqdnr" event={"ID":"2752e920-cf27-424c-9b2b-d9b3afc22e4a","Type":"ContainerStarted","Data":"a3ffbe81adb514b527e9f7181c012f370d96a7a3ba627bd449f51f100befc218"}
Sep 08 00:03:44.160066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.159908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:03:44.161131 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.161101    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vz4z5" event={"ID":"771a2276-e098-496d-adef-c937a913a59f","Type":"ContainerStarted","Data":"5f7ba60b3e3b5297af2ffc400e364c555b3ea97d1db202a1acaa955256d1021a"}
Sep 08 00:03:44.162202 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.162179    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7st" event={"ID":"0d159f5c-f279-48c1-affe-777c263a95e2","Type":"ContainerStarted","Data":"2a49e0f976c1c96e360627b1736db9a89d5a4337d14c56faf1420f6ac295a899"}
Sep 08 00:03:44.173954 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.173905    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-fqdnr" podStartSLOduration=66.173888866 podStartE2EDuration="1m6.173888866s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:44.172671591 +0000 UTC m=+66.923368438" watchObservedRunningTime="2026-09-08 00:03:44.173888866 +0000 UTC m=+66.924585720"
Sep 08 00:03:44.572130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.572085    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:44.572130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.572135    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:44.575038 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.575007    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a0e09e75-5706-4815-9b0a-1fde1ae647fd-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-c9gh5\" (UID: \"a0e09e75-5706-4815-9b0a-1fde1ae647fd\") " pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:44.575179 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.575014    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"image-registry-fc48cd7b6-v87bb\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") " pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:44.673637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.673594    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:44.673838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.673698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:44.676604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.676576    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5b7934f1-8ce1-475e-8524-f790689d0867-metrics-tls\") pod \"dns-default-z5mrt\" (UID: \"5b7934f1-8ce1-475e-8524-f790689d0867\") " pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:44.676805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.676778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/6b5d135d-83c8-46e4-97c4-c0078d034bda-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-8slz4\" (UID: \"6b5d135d-83c8-46e4-97c4-c0078d034bda\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:44.749020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.748853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-hwm5h\""
Sep 08 00:03:44.757547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.757504    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:44.774527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.774483    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:44.774728 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.774541    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:44.774728 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.774573    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:44.775598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.775560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-service-ca-bundle\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:44.777735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.777709    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ba4d08ce-90e0-452c-b2cb-abf00f6edbd3-metrics-certs\") pod \"router-default-7f4ff449fb-rc7hw\" (UID: \"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3\") " pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:44.777837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.777747    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/97b21b46-0b12-49ce-855d-9a41aa30eca6-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hwb4w\" (UID: \"97b21b46-0b12-49ce-855d-9a41aa30eca6\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:44.788067 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.788031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6jljx\""
Sep 08 00:03:44.795787 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.795750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5"
Sep 08 00:03:44.853056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.852853    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-pdh67\""
Sep 08 00:03:44.861566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.861528    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"
Sep 08 00:03:44.907942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.907864    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xbmqx\""
Sep 08 00:03:44.916866 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.916608    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:03:44.922610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.922547    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6spgz\""
Sep 08 00:03:44.930949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.930682    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"
Sep 08 00:03:44.933306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.933013    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-g5wvx\""
Sep 08 00:03:44.944250 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:44.943937    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:45.174036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.173645    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7st" event={"ID":"0d159f5c-f279-48c1-affe-777c263a95e2","Type":"ContainerStarted","Data":"ef8ce74bdaa5ecce92b117da33801aebce35592fdc42cb44c583abb0695c4e56"}
Sep 08 00:03:45.186011 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.185925    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4"]
Sep 08 00:03:45.189114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.188875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:03:45.193202 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:45.193174    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod429370e9_a846_489d_90f0_117f0970b16d.slice/crio-23da03a01767e6e39fc4b355a81d8c86ec34b086ae54f4e9f6549a8b212ed696 WatchSource:0}: Error finding container 23da03a01767e6e39fc4b355a81d8c86ec34b086ae54f4e9f6549a8b212ed696: Status 404 returned error can't find the container with id 23da03a01767e6e39fc4b355a81d8c86ec34b086ae54f4e9f6549a8b212ed696
Sep 08 00:03:45.196170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.196086    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-c9gh5"]
Sep 08 00:03:45.210237 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:45.210207    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e09e75_5706_4815_9b0a_1fde1ae647fd.slice/crio-649d83918946299f3b4557868c042bfd2f6af085db37c8435f83498aa62fe14e WatchSource:0}: Error finding container 649d83918946299f3b4557868c042bfd2f6af085db37c8435f83498aa62fe14e: Status 404 returned error can't find the container with id 649d83918946299f3b4557868c042bfd2f6af085db37c8435f83498aa62fe14e
Sep 08 00:03:45.261342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.261248    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5mrt"]
Sep 08 00:03:45.265338 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:45.265305    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7934f1_8ce1_475e_8524_f790689d0867.slice/crio-89ce6132aff2dd6e8d4d74ba40590e2279e144cde2da35c51b6e7c46ada59938 WatchSource:0}: Error finding container 89ce6132aff2dd6e8d4d74ba40590e2279e144cde2da35c51b6e7c46ada59938: Status 404 returned error can't find the container with id 89ce6132aff2dd6e8d4d74ba40590e2279e144cde2da35c51b6e7c46ada59938
Sep 08 00:03:45.285733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.285696    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7f4ff449fb-rc7hw"]
Sep 08 00:03:45.289648 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:45.289608    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4d08ce_90e0_452c_b2cb_abf00f6edbd3.slice/crio-10283387e0a3c7e07a112019be89b79b4d9eeed2d40093549cb3918c8bb5b1d3 WatchSource:0}: Error finding container 10283387e0a3c7e07a112019be89b79b4d9eeed2d40093549cb3918c8bb5b1d3: Status 404 returned error can't find the container with id 10283387e0a3c7e07a112019be89b79b4d9eeed2d40093549cb3918c8bb5b1d3
Sep 08 00:03:45.306165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:45.306110    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w"]
Sep 08 00:03:45.311501 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:03:45.311422    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97b21b46_0b12_49ce_855d_9a41aa30eca6.slice/crio-89c8932b42388220a1dd93f6f411165face7c8009358573c1a70d2706ab641cb WatchSource:0}: Error finding container 89c8932b42388220a1dd93f6f411165face7c8009358573c1a70d2706ab641cb: Status 404 returned error can't find the container with id 89c8932b42388220a1dd93f6f411165face7c8009358573c1a70d2706ab641cb
Sep 08 00:03:46.182081 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.182030    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4" event={"ID":"6b5d135d-83c8-46e4-97c4-c0078d034bda","Type":"ContainerStarted","Data":"be52c40b754d8cf478a87be6884aca4aa147f5469d1e73b8086daac665608ba1"}
Sep 08 00:03:46.185770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.185727    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-kl7st" event={"ID":"0d159f5c-f279-48c1-affe-777c263a95e2","Type":"ContainerStarted","Data":"536ed380d672aeba1d1660598c807b55025f33eae40d198d8d6b6fab7ec83003"}
Sep 08 00:03:46.195799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.192632    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5mrt" event={"ID":"5b7934f1-8ce1-475e-8524-f790689d0867","Type":"ContainerStarted","Data":"89ce6132aff2dd6e8d4d74ba40590e2279e144cde2da35c51b6e7c46ada59938"}
Sep 08 00:03:46.196637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.196602    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5" event={"ID":"a0e09e75-5706-4815-9b0a-1fde1ae647fd","Type":"ContainerStarted","Data":"649d83918946299f3b4557868c042bfd2f6af085db37c8435f83498aa62fe14e"}
Sep 08 00:03:46.201536 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.201504    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw" event={"ID":"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3","Type":"ContainerStarted","Data":"6304b3adca75708ae7036c8ce19e5e15a66212f2f5156e267b507c19081131f5"}
Sep 08 00:03:46.201753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.201736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw" event={"ID":"ba4d08ce-90e0-452c-b2cb-abf00f6edbd3","Type":"ContainerStarted","Data":"10283387e0a3c7e07a112019be89b79b4d9eeed2d40093549cb3918c8bb5b1d3"}
Sep 08 00:03:46.204218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.204144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w" event={"ID":"97b21b46-0b12-49ce-855d-9a41aa30eca6","Type":"ContainerStarted","Data":"89c8932b42388220a1dd93f6f411165face7c8009358573c1a70d2706ab641cb"}
Sep 08 00:03:46.208928 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.206744    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" event={"ID":"429370e9-a846-489d-90f0-117f0970b16d","Type":"ContainerStarted","Data":"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"}
Sep 08 00:03:46.209232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.209214    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:03:46.209363 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.209346    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" event={"ID":"429370e9-a846-489d-90f0-117f0970b16d","Type":"ContainerStarted","Data":"23da03a01767e6e39fc4b355a81d8c86ec34b086ae54f4e9f6549a8b212ed696"}
Sep 08 00:03:46.209536 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.208926    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-kl7st" podStartSLOduration=67.027176066 podStartE2EDuration="1m8.208905628s" totalImagesPullingTime="1.181729562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:46.207731816 +0000 UTC m=+68.958428661" watchObservedRunningTime="2026-09-08 00:03:46.208905628 +0000 UTC m=+68.959602475"
Sep 08 00:03:46.225761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.225325    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" podStartSLOduration=67.225297033 podStartE2EDuration="1m7.225297033s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:46.224105129 +0000 UTC m=+68.974801978" watchObservedRunningTime="2026-09-08 00:03:46.225297033 +0000 UTC m=+68.975993899"
Sep 08 00:03:46.242717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.241824    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw" podStartSLOduration=52.24176804 podStartE2EDuration="52.24176804s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:46.240836852 +0000 UTC m=+68.991533697" watchObservedRunningTime="2026-09-08 00:03:46.24176804 +0000 UTC m=+68.992464886"
Sep 08 00:03:46.767783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.767555    2580 scope.go:117] "RemoveContainer" containerID="1bd676219c7e2abf958ca09c90146d6cb32c371e181bfdbdbd82a162c3e21ea3"
Sep 08 00:03:46.945120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.945038    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:46.948334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:46.948303    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:47.211713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:47.211683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:47.213091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:47.213063    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7f4ff449fb-rc7hw"
Sep 08 00:03:51.231384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.231326    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:03:51.231938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.231436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-mr28b" event={"ID":"0327a736-a2fc-429e-a328-f00d3b243f42","Type":"ContainerStarted","Data":"f5c77c7213ab59708d32c53d410eeb1198297cf9f9acd6ba32a31b2953723cec"}
Sep 08 00:03:51.232504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.232276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:51.236682 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.236104    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4" event={"ID":"6b5d135d-83c8-46e4-97c4-c0078d034bda","Type":"ContainerStarted","Data":"37ab048bff7d131767e56773f6b5023d946cbfe53b3612e631b8db632752aa66"}
Sep 08 00:03:51.236682 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.236165    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4" event={"ID":"6b5d135d-83c8-46e4-97c4-c0078d034bda","Type":"ContainerStarted","Data":"d92ca45c952be63c7201685c2d25c9716df0ce01f31eb5b72c63cf4fdc6d539a"}
Sep 08 00:03:51.238644 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.238098    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vz4z5" event={"ID":"771a2276-e098-496d-adef-c937a913a59f","Type":"ContainerStarted","Data":"a778b00046b764dcbb2d26a580a9f011bab9afe2743009ce7ef60aa833bcc220"}
Sep 08 00:03:51.244604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.244566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5mrt" event={"ID":"5b7934f1-8ce1-475e-8524-f790689d0867","Type":"ContainerStarted","Data":"92b0c2cee3c47b78ecfbd87737ecff7b65aea293383ef6b5ac686c6f033f27fb"}
Sep 08 00:03:51.244805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.244633    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5mrt" event={"ID":"5b7934f1-8ce1-475e-8524-f790689d0867","Type":"ContainerStarted","Data":"420eeb9b3743e66bf8bbe226d59abbe71c51ff37ffc5330441ff017d05f50e15"}
Sep 08 00:03:51.246795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.246727    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-mr28b" podStartSLOduration=48.973155779 podStartE2EDuration="57.246697335s" totalImagesPullingTime="8.273541556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:51.24609125 +0000 UTC m=+73.996788097" watchObservedRunningTime="2026-09-08 00:03:51.246697335 +0000 UTC m=+73.997394171"
Sep 08 00:03:51.247601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.247562    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5" event={"ID":"a0e09e75-5706-4815-9b0a-1fde1ae647fd","Type":"ContainerStarted","Data":"7e989bc0cbf0e81b659924c7869f53820dde354ae493035d9b94bf5d10127eff"}
Sep 08 00:03:51.250200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.249971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w" event={"ID":"97b21b46-0b12-49ce-855d-9a41aa30eca6","Type":"ContainerStarted","Data":"875ad3852ad4d29a135fb0f8e98e0f4224b8ce6e6282c84da2c4b51dfe3dfdd8"}
Sep 08 00:03:51.262514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.262421    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vz4z5" podStartSLOduration=65.455314208 podStartE2EDuration="1m12.262399448s" totalImagesPullingTime="6.80708524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:51.262354095 +0000 UTC m=+74.013050940" watchObservedRunningTime="2026-09-08 00:03:51.262399448 +0000 UTC m=+74.013096292"
Sep 08 00:03:51.276995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.276912    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-8slz4" podStartSLOduration=51.745696064 podStartE2EDuration="57.276894634s" totalImagesPullingTime="5.53119857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:51.275517161 +0000 UTC m=+74.026214034" watchObservedRunningTime="2026-09-08 00:03:51.276894634 +0000 UTC m=+74.027591477"
Sep 08 00:03:51.297864 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.297792    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-c9gh5" podStartSLOduration=51.720826141 podStartE2EDuration="57.297768875s" totalImagesPullingTime="5.576942734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:51.296099379 +0000 UTC m=+74.046796225" watchObservedRunningTime="2026-09-08 00:03:51.297768875 +0000 UTC m=+74.048465722"
Sep 08 00:03:51.323511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.323368    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hwb4w" podStartSLOduration=51.845893934 podStartE2EDuration="57.3233493s" totalImagesPullingTime="5.477455366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:51.322640945 +0000 UTC m=+74.073337790" watchObservedRunningTime="2026-09-08 00:03:51.3233493 +0000 UTC m=+74.074046145"
Sep 08 00:03:51.886039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:51.886007    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-mr28b"
Sep 08 00:03:52.273179 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:52.273115    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z5mrt" podStartSLOduration=34.751901918 podStartE2EDuration="40.27309516s" totalImagesPullingTime="5.521193242s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:03:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:03:52.271599272 +0000 UTC m=+75.022296140" watchObservedRunningTime="2026-09-08 00:03:52.27309516 +0000 UTC m=+75.023792001"
Sep 08 00:03:53.258442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:03:53.258401    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:04:00.810510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.810358    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:00.814161 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.814139    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.816979 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.816945    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 00:04:00.817120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.816970    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 00:04:00.817120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817080    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 00:04:00.817120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817013    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 00:04:00.817291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817178    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k2h98\""
Sep 08 00:04:00.817348 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817291    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 00:04:00.817403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817376    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 00:04:00.817488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.817473    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 00:04:00.822245 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.821901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:00.910509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.910509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910514    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.910716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.910716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.910716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjft5\" (UniqueName: \"kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:00.910826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:00.910722    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011506    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011557    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011586    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjft5\" (UniqueName: \"kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.011800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.011695    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.012355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.012323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.012472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.012351    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.012472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.012366    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.014085 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.014060    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.014194 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.014177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.018773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.018737    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjft5\" (UniqueName: \"kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5\") pod \"console-5b6f7789b7-tpgj8\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") " pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.126054 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.125954    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:01.398739 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.398660    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:01.402100 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:04:01.402070    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2347daae_bf3e_4dd6_bf78_4a4aac6e1a0c.slice/crio-79c744030b85f1a650a0517c12100953b2dd7b1a79900dbe4b98b3f2f12a2e1f WatchSource:0}: Error finding container 79c744030b85f1a650a0517c12100953b2dd7b1a79900dbe4b98b3f2f12a2e1f: Status 404 returned error can't find the container with id 79c744030b85f1a650a0517c12100953b2dd7b1a79900dbe4b98b3f2f12a2e1f
Sep 08 00:04:01.937483 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.937430    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fnxgw"]
Sep 08 00:04:01.942037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.942009    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:01.943881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.943860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 00:04:01.943999 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.943865    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 00:04:01.944823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.944798    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 00:04:01.948668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.945346    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-7xzz2\""
Sep 08 00:04:01.948668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:01.946195    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 00:04:02.121784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.121784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-metrics-client-ca\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121805    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121886    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-root\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxq8g\" (UniqueName: \"kubernetes.io/projected/f49b369d-4cf4-4cd2-aefa-eb11a0747501-kube-api-access-hxq8g\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.121991    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-textfile\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122164 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.122019    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-wtmp\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.122164 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.122053    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-sys\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.222704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222662    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.222909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222711    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-metrics-client-ca\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.222909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222834    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.222909 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:04:02.222846    2580 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 00:04:02.222909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222880    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-root\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:04:02.222928    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls podName:f49b369d-4cf4-4cd2-aefa-eb11a0747501 nodeName:}" failed. No retries permitted until 2026-09-08 00:04:02.722904568 +0000 UTC m=+85.473601406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls") pod "node-exporter-fnxgw" (UID: "f49b369d-4cf4-4cd2-aefa-eb11a0747501") : secret "node-exporter-tls" not found
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222947    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-root\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.222955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxq8g\" (UniqueName: \"kubernetes.io/projected/f49b369d-4cf4-4cd2-aefa-eb11a0747501-kube-api-access-hxq8g\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-textfile\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223074    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-wtmp\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223127    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-sys\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-sys\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223362    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-metrics-client-ca\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-accelerators-collector-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223529    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-wtmp\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.223898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.223845    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-textfile\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.225906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.225882    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.231373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.231340    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxq8g\" (UniqueName: \"kubernetes.io/projected/f49b369d-4cf4-4cd2-aefa-eb11a0747501-kube-api-access-hxq8g\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.290948 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.290909    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f7789b7-tpgj8" event={"ID":"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c","Type":"ContainerStarted","Data":"79c744030b85f1a650a0517c12100953b2dd7b1a79900dbe4b98b3f2f12a2e1f"}
Sep 08 00:04:02.728150 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.728105    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.730937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.730906    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f49b369d-4cf4-4cd2-aefa-eb11a0747501-node-exporter-tls\") pod \"node-exporter-fnxgw\" (UID: \"f49b369d-4cf4-4cd2-aefa-eb11a0747501\") " pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.856728 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:02.856688    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fnxgw"
Sep 08 00:04:02.873878 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:04:02.873838    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49b369d_4cf4_4cd2_aefa_eb11a0747501.slice/crio-732c373e620a6fdbe9fc20529df9c83b631e54af5b7df9d550ae00304fb24615 WatchSource:0}: Error finding container 732c373e620a6fdbe9fc20529df9c83b631e54af5b7df9d550ae00304fb24615: Status 404 returned error can't find the container with id 732c373e620a6fdbe9fc20529df9c83b631e54af5b7df9d550ae00304fb24615
Sep 08 00:04:03.264733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:03.264692    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z5mrt"
Sep 08 00:04:03.298208 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:03.298160    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnxgw" event={"ID":"f49b369d-4cf4-4cd2-aefa-eb11a0747501","Type":"ContainerStarted","Data":"732c373e620a6fdbe9fc20529df9c83b631e54af5b7df9d550ae00304fb24615"}
Sep 08 00:04:05.307648 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:05.307609    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f7789b7-tpgj8" event={"ID":"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c","Type":"ContainerStarted","Data":"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"}
Sep 08 00:04:05.309340 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:05.309313    2580 generic.go:356] "Generic (PLEG): container finished" podID="f49b369d-4cf4-4cd2-aefa-eb11a0747501" containerID="83bada29a54c09584a74507c753468e6319b3132d69b00dc39e0f8c75792aa9f" exitCode=0
Sep 08 00:04:05.309463 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:05.309375    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnxgw" event={"ID":"f49b369d-4cf4-4cd2-aefa-eb11a0747501","Type":"ContainerDied","Data":"83bada29a54c09584a74507c753468e6319b3132d69b00dc39e0f8c75792aa9f"}
Sep 08 00:04:05.322988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:05.322939    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5b6f7789b7-tpgj8" podStartSLOduration=1.981860453 podStartE2EDuration="5.322923062s" totalImagesPullingTime="3.341062609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:04:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:05.321776233 +0000 UTC m=+88.072473077" watchObservedRunningTime="2026-09-08 00:04:05.322923062 +0000 UTC m=+88.073619907"
Sep 08 00:04:06.206140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.206096    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"]
Sep 08 00:04:06.209493 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.209469    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.211384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.211345    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 00:04:06.211531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.211447    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 00:04:06.211531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.211481    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 00:04:06.212357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.212338    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c914d88e6fn5s\""
Sep 08 00:04:06.212506 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.212489    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xf6bk\""
Sep 08 00:04:06.212578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.212534    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 00:04:06.217208 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.217181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"]
Sep 08 00:04:06.316439 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.316398    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnxgw" event={"ID":"f49b369d-4cf4-4cd2-aefa-eb11a0747501","Type":"ContainerStarted","Data":"3b5de6ba5185bf422a5e54d58926ab2c3e137336d8b0e654ac7d1d8c439400ed"}
Sep 08 00:04:06.316887 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.316479    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fnxgw" event={"ID":"f49b369d-4cf4-4cd2-aefa-eb11a0747501","Type":"ContainerStarted","Data":"b6524a67ccfddae96d5995a0ded466f2fbd762c81388e2bdf5b6a14095725cae"}
Sep 08 00:04:06.333975 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.333919    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fnxgw" podStartSLOduration=3.394589174 podStartE2EDuration="5.333897978s" totalImagesPullingTime="1.867118305s" totalInitContainerRuntime="72.190499ms" isStatefulPod=true podCreationTimestamp="2026-09-08 00:04:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:06.332335686 +0000 UTC m=+89.083032527" watchObservedRunningTime="2026-09-08 00:04:06.333897978 +0000 UTC m=+89.084594821"
Sep 08 00:04:06.363813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363765    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-client-certs\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-metrics-server-audit-profiles\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363860    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363882    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5z8px\" (UniqueName: \"kubernetes.io/projected/362d78f2-7d45-474a-a342-3eef67b58840-kube-api-access-5z8px\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363904    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-client-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-tls\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.363992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.363977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/362d78f2-7d45-474a-a342-3eef67b58840-audit-log\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464462 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464427    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5z8px\" (UniqueName: \"kubernetes.io/projected/362d78f2-7d45-474a-a342-3eef67b58840-kube-api-access-5z8px\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464498    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-client-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464555    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-tls\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464580    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/362d78f2-7d45-474a-a342-3eef67b58840-audit-log\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-client-certs\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-metrics-server-audit-profiles\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.464999 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.464983    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/362d78f2-7d45-474a-a342-3eef67b58840-audit-log\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.465055 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.465007    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.465666 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.465639    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.465866 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.465850    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/362d78f2-7d45-474a-a342-3eef67b58840-metrics-server-audit-profiles\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.467226 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.467198    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-tls\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.467338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.467204    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-client-ca-bundle\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.467434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.467415    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/362d78f2-7d45-474a-a342-3eef67b58840-secret-metrics-server-client-certs\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.472724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.472695    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5z8px\" (UniqueName: \"kubernetes.io/projected/362d78f2-7d45-474a-a342-3eef67b58840-kube-api-access-5z8px\") pod \"metrics-server-6d67c86b5b-5jzz9\" (UID: \"362d78f2-7d45-474a-a342-3eef67b58840\") " pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.519640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.519597    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:06.797244 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:06.797145    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"]
Sep 08 00:04:06.802213 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:04:06.802182    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod362d78f2_7d45_474a_a342_3eef67b58840.slice/crio-743114fccb90c466df5035e555379d9ac04faa010d328583f10fc3c1fcedf099 WatchSource:0}: Error finding container 743114fccb90c466df5035e555379d9ac04faa010d328583f10fc3c1fcedf099: Status 404 returned error can't find the container with id 743114fccb90c466df5035e555379d9ac04faa010d328583f10fc3c1fcedf099
Sep 08 00:04:07.322752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:07.322711    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9" event={"ID":"362d78f2-7d45-474a-a342-3eef67b58840","Type":"ContainerStarted","Data":"743114fccb90c466df5035e555379d9ac04faa010d328583f10fc3c1fcedf099"}
Sep 08 00:04:08.221417 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:08.221385    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:04:08.330818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:08.330781    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9" event={"ID":"362d78f2-7d45-474a-a342-3eef67b58840","Type":"ContainerStarted","Data":"4c6ede003c359a6fe2e7b988dcffb0679a4c390afc873f638627c2a5aec3138d"}
Sep 08 00:04:08.353290 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:08.353237    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9" podStartSLOduration=0.95857268 podStartE2EDuration="2.353218798s" totalImagesPullingTime="1.394646118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:04:08.351048622 +0000 UTC m=+91.101745466" watchObservedRunningTime="2026-09-08 00:04:08.353218798 +0000 UTC m=+91.103915643"
Sep 08 00:04:09.694567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:09.694530    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:04:11.126617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:11.126567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:11.127133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:11.126639    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:11.131705 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:11.131678    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:11.348046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:11.348014    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:15.176374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:15.176339    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-fqdnr"
Sep 08 00:04:19.514180 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:19.514142    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:26.520575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:26.520533    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:26.521195 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:26.520608    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:34.715292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.715219    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" podUID="429370e9-a846-489d-90f0-117f0970b16d" containerName="registry" containerID="cri-o://dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c" gracePeriod=30
Sep 08 00:04:34.954945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.954910    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:04:34.984842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984745    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.984842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984837    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984867    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984901    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984943    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.984985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.985021    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.985055    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6pw8q\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q\") pod \"429370e9-a846-489d-90f0-117f0970b16d\" (UID: \"429370e9-a846-489d-90f0-117f0970b16d\") "
Sep 08 00:04:34.985423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.985353    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:34.985499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.985436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:34.987711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.987672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:34.987964 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.987912    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:34.987964 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.987947    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:34.988152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.988000    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:34.988152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.988028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q" (OuterVolumeSpecName: "kube-api-access-6pw8q") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "kube-api-access-6pw8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:34.994238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:34.994189    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "429370e9-a846-489d-90f0-117f0970b16d" (UID: "429370e9-a846-489d-90f0-117f0970b16d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:04:35.086553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086513    2580 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-registry-certificates\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086549    2580 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-image-registry-private-configuration\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086559    2580 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/429370e9-a846-489d-90f0-117f0970b16d-ca-trust-extracted\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086568    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6pw8q\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-kube-api-access-6pw8q\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086578    2580 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-bound-sa-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086587    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/429370e9-a846-489d-90f0-117f0970b16d-trusted-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086595    2580 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/429370e9-a846-489d-90f0-117f0970b16d-registry-tls\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.086803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.086602    2580 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/429370e9-a846-489d-90f0-117f0970b16d-installation-pull-secrets\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:35.445590 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.445507    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb"
Sep 08 00:04:35.445590 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.445531    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" event={"ID":"429370e9-a846-489d-90f0-117f0970b16d","Type":"ContainerDied","Data":"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"}
Sep 08 00:04:35.445828 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.445503    2580 generic.go:356] "Generic (PLEG): container finished" podID="429370e9-a846-489d-90f0-117f0970b16d" containerID="dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c" exitCode=0
Sep 08 00:04:35.445828 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.445607    2580 scope.go:117] "RemoveContainer" containerID="dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"
Sep 08 00:04:35.445828 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.445702    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-fc48cd7b6-v87bb" event={"ID":"429370e9-a846-489d-90f0-117f0970b16d","Type":"ContainerDied","Data":"23da03a01767e6e39fc4b355a81d8c86ec34b086ae54f4e9f6549a8b212ed696"}
Sep 08 00:04:35.454620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.454602    2580 scope.go:117] "RemoveContainer" containerID="dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"
Sep 08 00:04:35.454986 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:04:35.454958    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c\": container with ID starting with dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c not found: ID does not exist" containerID="dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"
Sep 08 00:04:35.455042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.454996    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c"} err="failed to get container status \"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c\": rpc error: code = NotFound desc = could not find container \"dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c\": container with ID starting with dea4843aaba2145edbdec87868fb5ffe428540cbd6cbf6124e3161937ee7e97c not found: ID does not exist"
Sep 08 00:04:35.464938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.464910    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:04:35.468301 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.468276    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc48cd7b6-v87bb"]
Sep 08 00:04:35.772786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:35.772748    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="429370e9-a846-489d-90f0-117f0970b16d" path="/var/lib/kubelet/pods/429370e9-a846-489d-90f0-117f0970b16d/volumes"
Sep 08 00:04:44.485509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.485443    2580 generic.go:356] "Generic (PLEG): container finished" podID="025ffe90-b36a-460d-88d5-7c9fd0dd0153" containerID="d7a453dd2c1d4fc46656debaf3d9499a66543ffe289e65200d9a47adf7c95b22" exitCode=0
Sep 08 00:04:44.485947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.485518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29813760-gjbvs" event={"ID":"025ffe90-b36a-460d-88d5-7c9fd0dd0153","Type":"ContainerDied","Data":"d7a453dd2c1d4fc46656debaf3d9499a66543ffe289e65200d9a47adf7c95b22"}
Sep 08 00:04:44.535338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.535301    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5b6f7789b7-tpgj8" podUID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" containerName="console" containerID="cri-o://c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f" gracePeriod=15
Sep 08 00:04:44.775761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.775730    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:44.863299 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863244    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863299 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863315    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863339    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863379    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjft5\" (UniqueName: \"kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863507    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert\") pod \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\" (UID: \"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c\") "
Sep 08 00:04:44.863825 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863783    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:44.863924 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.863899    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config" (OuterVolumeSpecName: "console-config") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:44.864045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.864016    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:44.865784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.865744    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:44.865917 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.865808    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:04:44.865917 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.865877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5" (OuterVolumeSpecName: "kube-api-access-tjft5") pod "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" (UID: "2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c"). InnerVolumeSpecName "kube-api-access-tjft5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:44.964658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964626    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjft5\" (UniqueName: \"kubernetes.io/projected/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-kube-api-access-tjft5\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:44.964658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964659    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-oauth-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:44.964862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964669    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-oauth-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:44.964862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964680    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:44.964862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964689    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:44.964862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:44.964697    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c-console-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:45.491137 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.491100    2580 generic.go:356] "Generic (PLEG): container finished" podID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" containerID="c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f" exitCode=0
Sep 08 00:04:45.491604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.491142    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5b6f7789b7-tpgj8"
Sep 08 00:04:45.491604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.491181    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f7789b7-tpgj8" event={"ID":"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c","Type":"ContainerDied","Data":"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"}
Sep 08 00:04:45.491604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.491235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5b6f7789b7-tpgj8" event={"ID":"2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c","Type":"ContainerDied","Data":"79c744030b85f1a650a0517c12100953b2dd7b1a79900dbe4b98b3f2f12a2e1f"}
Sep 08 00:04:45.491604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.491263    2580 scope.go:117] "RemoveContainer" containerID="c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"
Sep 08 00:04:45.501677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.501656    2580 scope.go:117] "RemoveContainer" containerID="c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"
Sep 08 00:04:45.502063 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:04:45.502039    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f\": container with ID starting with c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f not found: ID does not exist" containerID="c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"
Sep 08 00:04:45.502112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.502073    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f"} err="failed to get container status \"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f\": rpc error: code = NotFound desc = could not find container \"c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f\": container with ID starting with c4d6239d55a2c286fdd8cb51fc6733af96acb65275842802a65d3ce2277a1a0f not found: ID does not exist"
Sep 08 00:04:45.511222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.511187    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:45.516569 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.516532    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5b6f7789b7-tpgj8"]
Sep 08 00:04:45.625259 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.625228    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:04:45.769973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.769876    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca\") pod \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") "
Sep 08 00:04:45.769973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.769926    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fkgvk\" (UniqueName: \"kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk\") pod \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\" (UID: \"025ffe90-b36a-460d-88d5-7c9fd0dd0153\") "
Sep 08 00:04:45.770333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.770305    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca" (OuterVolumeSpecName: "serviceca") pod "025ffe90-b36a-460d-88d5-7c9fd0dd0153" (UID: "025ffe90-b36a-460d-88d5-7c9fd0dd0153"). InnerVolumeSpecName "serviceca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:04:45.772445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.772404    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk" (OuterVolumeSpecName: "kube-api-access-fkgvk") pod "025ffe90-b36a-460d-88d5-7c9fd0dd0153" (UID: "025ffe90-b36a-460d-88d5-7c9fd0dd0153"). InnerVolumeSpecName "kube-api-access-fkgvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:04:45.772920 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.772895    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" path="/var/lib/kubelet/pods/2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c/volumes"
Sep 08 00:04:45.870583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.870539    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkgvk\" (UniqueName: \"kubernetes.io/projected/025ffe90-b36a-460d-88d5-7c9fd0dd0153-kube-api-access-fkgvk\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:45.870583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:45.870572    2580 reconciler_common.go:299] "Volume detached for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/025ffe90-b36a-460d-88d5-7c9fd0dd0153-serviceca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:04:46.497116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:46.497083    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-pruner-29813760-gjbvs"
Sep 08 00:04:46.497521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:46.497080    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-pruner-29813760-gjbvs" event={"ID":"025ffe90-b36a-460d-88d5-7c9fd0dd0153","Type":"ContainerDied","Data":"2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493"}
Sep 08 00:04:46.497521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:46.497206    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f5da6f90c9b2b20aaba5eae83f52424feb8cfd36fb6105a53b71312cee4f493"
Sep 08 00:04:46.526174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:46.526139    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:46.530159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:46.530129    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6d67c86b5b-5jzz9"
Sep 08 00:04:47.502578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:47.502542    2580 generic.go:356] "Generic (PLEG): container finished" podID="cd61e51b-6dc4-4462-8bbc-3858f532c644" containerID="476fdf31a4a1d8c6a50f2bca10369e969f28e8701c6e43b8e9528ac930f29f45" exitCode=0
Sep 08 00:04:47.502983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:47.502616    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9" event={"ID":"cd61e51b-6dc4-4462-8bbc-3858f532c644","Type":"ContainerDied","Data":"476fdf31a4a1d8c6a50f2bca10369e969f28e8701c6e43b8e9528ac930f29f45"}
Sep 08 00:04:47.503045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:47.503028    2580 scope.go:117] "RemoveContainer" containerID="476fdf31a4a1d8c6a50f2bca10369e969f28e8701c6e43b8e9528ac930f29f45"
Sep 08 00:04:48.508187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:48.508149    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-vmwv9" event={"ID":"cd61e51b-6dc4-4462-8bbc-3858f532c644","Type":"ContainerStarted","Data":"86e2006a45d0c4335c230ce924cda93f31116b0c7dba861e5b83a0707ee234b7"}
Sep 08 00:04:53.528072 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:53.528031    2580 generic.go:356] "Generic (PLEG): container finished" podID="9c79ec42-bd9b-47ef-a35b-a75046a2d94f" containerID="cdf903ccb886ff6f75570af0fcfa2d2fa822912612b4578832f60a3bf1fb4886" exitCode=0
Sep 08 00:04:53.528527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:53.528106    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft" event={"ID":"9c79ec42-bd9b-47ef-a35b-a75046a2d94f","Type":"ContainerDied","Data":"cdf903ccb886ff6f75570af0fcfa2d2fa822912612b4578832f60a3bf1fb4886"}
Sep 08 00:04:53.528527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:53.528501    2580 scope.go:117] "RemoveContainer" containerID="cdf903ccb886ff6f75570af0fcfa2d2fa822912612b4578832f60a3bf1fb4886"
Sep 08 00:04:54.533720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:54.533681    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-fbcft" event={"ID":"9c79ec42-bd9b-47ef-a35b-a75046a2d94f","Type":"ContainerStarted","Data":"ad0a4d43963171ffe010b63ff20d58792eee250410e9a80facf5351d0ea5a02a"}
Sep 08 00:04:57.547434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:57.547395    2580 generic.go:356] "Generic (PLEG): container finished" podID="5d447b60-336e-40e2-bb30-6d486427c4eb" containerID="ad3981cd4ff25a0ceef9a43eefb79e7000c00cdde6912a37e79c6c88d63a42c8" exitCode=0
Sep 08 00:04:57.547871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:57.547488    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9" event={"ID":"5d447b60-336e-40e2-bb30-6d486427c4eb","Type":"ContainerDied","Data":"ad3981cd4ff25a0ceef9a43eefb79e7000c00cdde6912a37e79c6c88d63a42c8"}
Sep 08 00:04:57.547914 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:57.547869    2580 scope.go:117] "RemoveContainer" containerID="ad3981cd4ff25a0ceef9a43eefb79e7000c00cdde6912a37e79c6c88d63a42c8"
Sep 08 00:04:58.553418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:04:58.553377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-vkxj9" event={"ID":"5d447b60-336e-40e2-bb30-6d486427c4eb","Type":"ContainerStarted","Data":"b2717f415134e107961b3ac8cdcced8306d15b473f2d323cfda67c43c1c9d96b"}
Sep 08 00:05:28.811108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.811065    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:05:28.812771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812741    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="025ffe90-b36a-460d-88d5-7c9fd0dd0153" containerName="image-pruner"
Sep 08 00:05:28.812771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812773    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="025ffe90-b36a-460d-88d5-7c9fd0dd0153" containerName="image-pruner"
Sep 08 00:05:28.812916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812793    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="429370e9-a846-489d-90f0-117f0970b16d" containerName="registry"
Sep 08 00:05:28.812916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812806    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="429370e9-a846-489d-90f0-117f0970b16d" containerName="registry"
Sep 08 00:05:28.812916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812827    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" containerName="console"
Sep 08 00:05:28.812916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812836    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" containerName="console"
Sep 08 00:05:28.812916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812903    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="429370e9-a846-489d-90f0-117f0970b16d" containerName="registry"
Sep 08 00:05:28.813066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812917    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="025ffe90-b36a-460d-88d5-7c9fd0dd0153" containerName="image-pruner"
Sep 08 00:05:28.813066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.812925    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2347daae-bf3e-4dd6-bf78-4a4aac6e1a0c" containerName="console"
Sep 08 00:05:28.816211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.816182    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.819121 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819096    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-k2h98\""
Sep 08 00:05:28.819248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819098    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 00:05:28.819248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819236    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 00:05:28.819360 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819285    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 00:05:28.819360 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819096    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 00:05:28.819488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819369    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 00:05:28.819735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819715    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 00:05:28.819850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.819737    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 00:05:28.824504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.824444    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 00:05:28.825611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.825585    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:05:28.902663 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.902846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.902846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902693    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.902846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.902846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902750    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.902846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902811    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:28.903020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:28.902864    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrgc6\" (UniqueName: \"kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.003900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.003900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003902    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003924    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrgc6\" (UniqueName: \"kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003942    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.003993    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.004033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.004758    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.004769    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004957 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.004820    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.004957 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.004946    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.006613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.006592    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.006757 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.006738    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.011345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.011320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrgc6\" (UniqueName: \"kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6\") pod \"console-5fff7fd8cd-2c6g4\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") " pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.127979 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.127878    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:29.398734 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.398641    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:05:29.402637 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:05:29.402606    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf52ded02_e9f6_46b8_b043_669cdcef4540.slice/crio-03b8241d9155643851db2423404b6807fd7c76cdb8f3fd2a5017af623b5a5261 WatchSource:0}: Error finding container 03b8241d9155643851db2423404b6807fd7c76cdb8f3fd2a5017af623b5a5261: Status 404 returned error can't find the container with id 03b8241d9155643851db2423404b6807fd7c76cdb8f3fd2a5017af623b5a5261
Sep 08 00:05:29.681163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.681067    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff7fd8cd-2c6g4" event={"ID":"f52ded02-e9f6-46b8-b043-669cdcef4540","Type":"ContainerStarted","Data":"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"}
Sep 08 00:05:29.681163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.681130    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff7fd8cd-2c6g4" event={"ID":"f52ded02-e9f6-46b8-b043-669cdcef4540","Type":"ContainerStarted","Data":"03b8241d9155643851db2423404b6807fd7c76cdb8f3fd2a5017af623b5a5261"}
Sep 08 00:05:29.695252 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:29.695190    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5fff7fd8cd-2c6g4" podStartSLOduration=1.6951725560000002 podStartE2EDuration="1.695172556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:05:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:05:29.695050929 +0000 UTC m=+172.445747775" watchObservedRunningTime="2026-09-08 00:05:29.695172556 +0000 UTC m=+172.445869399"
Sep 08 00:05:39.128432 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:39.128383    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:39.129002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:39.128476    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:39.133632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:39.133605    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:05:39.723761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:05:39.723733    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:06:44.780589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.780541    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:06:44.784056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.784028    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.794097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.794060    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:06:44.815081 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815115    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815173    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrrz9\" (UniqueName: \"kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815291    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.815538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.815328    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.916769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.916719    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.916971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.916783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.916971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.916823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.916971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.916843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.916971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.916867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrrz9\" (UniqueName: \"kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.917209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.917209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917132    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.917640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.917818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917735    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.917941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917898    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.918018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.917955    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.919514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.919491    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.919869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.919848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:44.924228 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:44.924193    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrrz9\" (UniqueName: \"kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9\") pod \"console-55cc77ff7b-87vbg\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") " pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:45.095358 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:45.095241    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:45.374135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:45.374054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:06:45.376806 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:06:45.376775    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a7bdc3_1313_47d3_9390_d84cebfa37f9.slice/crio-8ca27ac79d8fdb3d83d692d3d1e5251599492547a280a20fa1bc69774c7aa8ad WatchSource:0}: Error finding container 8ca27ac79d8fdb3d83d692d3d1e5251599492547a280a20fa1bc69774c7aa8ad: Status 404 returned error can't find the container with id 8ca27ac79d8fdb3d83d692d3d1e5251599492547a280a20fa1bc69774c7aa8ad
Sep 08 00:06:45.972754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:45.972710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc77ff7b-87vbg" event={"ID":"07a7bdc3-1313-47d3-9390-d84cebfa37f9","Type":"ContainerStarted","Data":"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"}
Sep 08 00:06:45.973219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:45.972778    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc77ff7b-87vbg" event={"ID":"07a7bdc3-1313-47d3-9390-d84cebfa37f9","Type":"ContainerStarted","Data":"8ca27ac79d8fdb3d83d692d3d1e5251599492547a280a20fa1bc69774c7aa8ad"}
Sep 08 00:06:45.987892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:45.987837    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55cc77ff7b-87vbg" podStartSLOduration=1.987820462 podStartE2EDuration="1.987820462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:06:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:06:45.986321999 +0000 UTC m=+248.737018854" watchObservedRunningTime="2026-09-08 00:06:45.987820462 +0000 UTC m=+248.738517340"
Sep 08 00:06:55.095684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:55.095632    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:55.096344 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:55.095709    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:55.101581 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:55.101551    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:56.021228 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:56.021196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:06:56.062931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:06:56.062881    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:07:21.087001 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.086940    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5fff7fd8cd-2c6g4" podUID="f52ded02-e9f6-46b8-b043-669cdcef4540" containerName="console" containerID="cri-o://7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b" gracePeriod=15
Sep 08 00:07:21.329921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.329888    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:07:21.419869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.419776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.419869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.419828    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.419874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.419913    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.419949    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420048    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrgc6\" (UniqueName: \"kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6\") pod \"f52ded02-e9f6-46b8-b043-669cdcef4540\" (UID: \"f52ded02-e9f6-46b8-b043-669cdcef4540\") "
Sep 08 00:07:21.420433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420405    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca" (OuterVolumeSpecName: "service-ca") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:07:21.420524 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420417    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config" (OuterVolumeSpecName: "console-config") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:07:21.420524 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:07:21.420524 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.420502    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:07:21.422176 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.422143    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:07:21.422176 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.422157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:07:21.422311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.422162    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6" (OuterVolumeSpecName: "kube-api-access-rrgc6") pod "f52ded02-e9f6-46b8-b043-669cdcef4540" (UID: "f52ded02-e9f6-46b8-b043-669cdcef4540"). InnerVolumeSpecName "kube-api-access-rrgc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:07:21.520939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520899    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-trusted-ca-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.520939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520931    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrgc6\" (UniqueName: \"kubernetes.io/projected/f52ded02-e9f6-46b8-b043-669cdcef4540-kube-api-access-rrgc6\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.520939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520942    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.521178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520956    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.521178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520969    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-console-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.521178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520977    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f52ded02-e9f6-46b8-b043-669cdcef4540-console-oauth-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:21.521178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:21.520985    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f52ded02-e9f6-46b8-b043-669cdcef4540-oauth-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:07:22.117157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.117050    2580 generic.go:356] "Generic (PLEG): container finished" podID="f52ded02-e9f6-46b8-b043-669cdcef4540" containerID="7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b" exitCode=0
Sep 08 00:07:22.117157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.117105    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5fff7fd8cd-2c6g4"
Sep 08 00:07:22.117157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.117144    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff7fd8cd-2c6g4" event={"ID":"f52ded02-e9f6-46b8-b043-669cdcef4540","Type":"ContainerDied","Data":"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"}
Sep 08 00:07:22.117740 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.117195    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5fff7fd8cd-2c6g4" event={"ID":"f52ded02-e9f6-46b8-b043-669cdcef4540","Type":"ContainerDied","Data":"03b8241d9155643851db2423404b6807fd7c76cdb8f3fd2a5017af623b5a5261"}
Sep 08 00:07:22.117740 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.117215    2580 scope.go:117] "RemoveContainer" containerID="7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"
Sep 08 00:07:22.126014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.125992    2580 scope.go:117] "RemoveContainer" containerID="7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"
Sep 08 00:07:22.126290 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:07:22.126272    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b\": container with ID starting with 7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b not found: ID does not exist" containerID="7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"
Sep 08 00:07:22.126351 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.126298    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b"} err="failed to get container status \"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b\": rpc error: code = NotFound desc = could not find container \"7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b\": container with ID starting with 7d83e04d488074b56d50edfeb3edf8381a6e1e9b16df5b3cb6e5411f8c8d294b not found: ID does not exist"
Sep 08 00:07:22.130446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.130413    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:07:22.133993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:22.133967    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5fff7fd8cd-2c6g4"]
Sep 08 00:07:23.772089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:23.772045    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f52ded02-e9f6-46b8-b043-669cdcef4540" path="/var/lib/kubelet/pods/f52ded02-e9f6-46b8-b043-669cdcef4540/volumes"
Sep 08 00:07:37.676093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:37.676062    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:07:37.680123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:37.680098    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:07:37.687618 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:37.687587    2580 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 00:07:52.886765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.886721    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"]
Sep 08 00:07:52.889206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.887022    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f52ded02-e9f6-46b8-b043-669cdcef4540" containerName="console"
Sep 08 00:07:52.889206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.887034    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f52ded02-e9f6-46b8-b043-669cdcef4540" containerName="console"
Sep 08 00:07:52.889206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.887085    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f52ded02-e9f6-46b8-b043-669cdcef4540" containerName="console"
Sep 08 00:07:52.890127 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.890108    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:52.892427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.892405    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:07:52.892575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.892467    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:07:52.893197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.893177    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6qrrx\""
Sep 08 00:07:52.898373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.898346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"]
Sep 08 00:07:52.967437 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.967396    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ww2q\" (UniqueName: \"kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:52.967635 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.967447    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:52.967635 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:52.967535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.068962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.068919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.069160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.068974    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ww2q\" (UniqueName: \"kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.069160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.069004    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.069326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.069305    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.069384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.069334    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.076516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.076486    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ww2q\" (UniqueName: \"kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.200803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.200707    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:07:53.474616 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.474575    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"]
Sep 08 00:07:53.478201 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:07:53.478167    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03959da0_1e09_4477_bffd_e73ab4647ba6.slice/crio-d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368 WatchSource:0}: Error finding container d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368: Status 404 returned error can't find the container with id d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368
Sep 08 00:07:53.480607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:53.480588    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:07:54.243561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:07:54.243525    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx" event={"ID":"03959da0-1e09-4477-bffd-e73ab4647ba6","Type":"ContainerStarted","Data":"d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368"}
Sep 08 00:08:00.271881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:00.271842    2580 generic.go:356] "Generic (PLEG): container finished" podID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerID="508b7cd81369f82cbdfa2a333443b05700f9545c7a920e68fe9af9e57e31a1c7" exitCode=0
Sep 08 00:08:00.272294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:00.271929    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx" event={"ID":"03959da0-1e09-4477-bffd-e73ab4647ba6","Type":"ContainerDied","Data":"508b7cd81369f82cbdfa2a333443b05700f9545c7a920e68fe9af9e57e31a1c7"}
Sep 08 00:08:03.287523 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:03.287489    2580 generic.go:356] "Generic (PLEG): container finished" podID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerID="21034f7a015ab685bad1e45d7c5a8b134ca7b1e819b92c8216e6b5b25924717c" exitCode=0
Sep 08 00:08:03.287929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:03.287566    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx" event={"ID":"03959da0-1e09-4477-bffd-e73ab4647ba6","Type":"ContainerDied","Data":"21034f7a015ab685bad1e45d7c5a8b134ca7b1e819b92c8216e6b5b25924717c"}
Sep 08 00:08:10.323193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:10.323079    2580 generic.go:356] "Generic (PLEG): container finished" podID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerID="624ccc217d7b9b3c97a6fa412f9eb71e540e050cd6e7deabe6af50d6ca535e54" exitCode=0
Sep 08 00:08:10.323193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:10.323164    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx" event={"ID":"03959da0-1e09-4477-bffd-e73ab4647ba6","Type":"ContainerDied","Data":"624ccc217d7b9b3c97a6fa412f9eb71e540e050cd6e7deabe6af50d6ca535e54"}
Sep 08 00:08:11.454109 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.454079    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:08:11.528632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.528591    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ww2q\" (UniqueName: \"kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q\") pod \"03959da0-1e09-4477-bffd-e73ab4647ba6\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") "
Sep 08 00:08:11.528810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.528682    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util\") pod \"03959da0-1e09-4477-bffd-e73ab4647ba6\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") "
Sep 08 00:08:11.528810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.528707    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle\") pod \"03959da0-1e09-4477-bffd-e73ab4647ba6\" (UID: \"03959da0-1e09-4477-bffd-e73ab4647ba6\") "
Sep 08 00:08:11.529398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.529370    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle" (OuterVolumeSpecName: "bundle") pod "03959da0-1e09-4477-bffd-e73ab4647ba6" (UID: "03959da0-1e09-4477-bffd-e73ab4647ba6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:08:11.530983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.530954    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q" (OuterVolumeSpecName: "kube-api-access-2ww2q") pod "03959da0-1e09-4477-bffd-e73ab4647ba6" (UID: "03959da0-1e09-4477-bffd-e73ab4647ba6"). InnerVolumeSpecName "kube-api-access-2ww2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:08:11.533442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.533414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util" (OuterVolumeSpecName: "util") pod "03959da0-1e09-4477-bffd-e73ab4647ba6" (UID: "03959da0-1e09-4477-bffd-e73ab4647ba6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:08:11.629775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.629668    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:11.629775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.629715    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ww2q\" (UniqueName: \"kubernetes.io/projected/03959da0-1e09-4477-bffd-e73ab4647ba6-kube-api-access-2ww2q\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:11.629775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:11.629726    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/03959da0-1e09-4477-bffd-e73ab4647ba6-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:12.333877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:12.333849    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx"
Sep 08 00:08:12.334045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:12.333847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540q7mlx" event={"ID":"03959da0-1e09-4477-bffd-e73ab4647ba6","Type":"ContainerDied","Data":"d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368"}
Sep 08 00:08:12.334045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:12.333969    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5314a69c18c43f41138bf6dcef5e511be446e7f22cdf805acf58ff26861d368"
Sep 08 00:08:15.799206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799163    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"]
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799583    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="pull"
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799602    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="pull"
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799626    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="extract"
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799634    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="extract"
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799655    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="util"
Sep 08 00:08:15.799749 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799663    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="util"
Sep 08 00:08:15.800028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.799753    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="03959da0-1e09-4477-bffd-e73ab4647ba6" containerName="extract"
Sep 08 00:08:15.843180 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.843136    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"]
Sep 08 00:08:15.843333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.843265    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:15.845551 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.845523    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 00:08:15.845551 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.845554    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 00:08:15.845798 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.845643    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-257x8\""
Sep 08 00:08:15.964734 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.964694    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf4c6\" (UniqueName: \"kubernetes.io/projected/eeb4d4ea-e161-4d52-82fa-4a15ad216304-kube-api-access-kf4c6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:15.964906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:15.964798    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb4d4ea-e161-4d52-82fa-4a15ad216304-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.065985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.065886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb4d4ea-e161-4d52-82fa-4a15ad216304-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.065985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.065980    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf4c6\" (UniqueName: \"kubernetes.io/projected/eeb4d4ea-e161-4d52-82fa-4a15ad216304-kube-api-access-kf4c6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.066312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.066277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eeb4d4ea-e161-4d52-82fa-4a15ad216304-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.073159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.073127    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf4c6\" (UniqueName: \"kubernetes.io/projected/eeb4d4ea-e161-4d52-82fa-4a15ad216304-kube-api-access-kf4c6\") pod \"cert-manager-operator-controller-manager-55c444bf86-zx4wl\" (UID: \"eeb4d4ea-e161-4d52-82fa-4a15ad216304\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.152579 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.152545    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"
Sep 08 00:08:16.449654 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:16.449628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl"]
Sep 08 00:08:16.451947 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:08:16.451919    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb4d4ea_e161_4d52_82fa_4a15ad216304.slice/crio-3aa406758c11bcd4277bb8f365817a966845d4a09142ad5c710f6ceee03293b8 WatchSource:0}: Error finding container 3aa406758c11bcd4277bb8f365817a966845d4a09142ad5c710f6ceee03293b8: Status 404 returned error can't find the container with id 3aa406758c11bcd4277bb8f365817a966845d4a09142ad5c710f6ceee03293b8
Sep 08 00:08:17.354355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:17.354261    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl" event={"ID":"eeb4d4ea-e161-4d52-82fa-4a15ad216304","Type":"ContainerStarted","Data":"3aa406758c11bcd4277bb8f365817a966845d4a09142ad5c710f6ceee03293b8"}
Sep 08 00:08:18.360663 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:18.360571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl" event={"ID":"eeb4d4ea-e161-4d52-82fa-4a15ad216304","Type":"ContainerStarted","Data":"7f22c470703664748013c47ba74c966ad3201fe4389a51a1b151f66dbb20e1dd"}
Sep 08 00:08:18.380741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:18.380670    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zx4wl" podStartSLOduration=1.7902802009999998 podStartE2EDuration="3.38064441s" totalImagesPullingTime="1.590364209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:08:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:08:18.378317651 +0000 UTC m=+341.129014499" watchObservedRunningTime="2026-09-08 00:08:18.38064441 +0000 UTC m=+341.131341254"
Sep 08 00:08:19.708692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.708644    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"]
Sep 08 00:08:19.713518 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.712673    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.715245 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.715222    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6qrrx\""
Sep 08 00:08:19.715355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.715265    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:08:19.715721 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.715703    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:08:19.719116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.719089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"]
Sep 08 00:08:19.795074 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.795029    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.795267 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.795091    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkjdj\" (UniqueName: \"kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.795267 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.795141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.896504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.896443    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.896699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.896537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkjdj\" (UniqueName: \"kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.896699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.896574    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.896839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.896818    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.896931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.896914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.903998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.903967    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkjdj\" (UniqueName: \"kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:19.934989 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.934955    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwdd2"]
Sep 08 00:08:19.938227 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.938202    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:19.940307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.940282    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 00:08:19.940540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.940378    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-2qqbm\""
Sep 08 00:08:19.940540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.940421    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 00:08:19.945288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:19.945263    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwdd2"]
Sep 08 00:08:20.023566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.023532    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:20.097977 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.097945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.098123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.098035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9wbr\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-kube-api-access-m9wbr\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.198716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.198667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9wbr\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-kube-api-access-m9wbr\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.198912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.198744    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.207722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.207685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.207847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.207792    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9wbr\" (UniqueName: \"kubernetes.io/projected/22be77bd-6df9-4449-877a-552ace553114-kube-api-access-m9wbr\") pod \"cert-manager-webhook-6486ffd997-wwdd2\" (UID: \"22be77bd-6df9-4449-877a-552ace553114\") " pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.256782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.256732    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:20.301056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.300971    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"]
Sep 08 00:08:20.304594 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:08:20.304556    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f91ed6a_fef4_493e_9103_aac8356d8f3a.slice/crio-9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e WatchSource:0}: Error finding container 9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e: Status 404 returned error can't find the container with id 9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e
Sep 08 00:08:20.371274 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.371238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb" event={"ID":"3f91ed6a-fef4-493e-9103-aac8356d8f3a","Type":"ContainerStarted","Data":"9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e"}
Sep 08 00:08:20.531945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:20.531909    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-wwdd2"]
Sep 08 00:08:20.535129 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:08:20.535100    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22be77bd_6df9_4449_877a_552ace553114.slice/crio-a4e6cc24bce245b8c302aca29b9e4a11957b6d345d42fd61256ce5d1e3e2adec WatchSource:0}: Error finding container a4e6cc24bce245b8c302aca29b9e4a11957b6d345d42fd61256ce5d1e3e2adec: Status 404 returned error can't find the container with id a4e6cc24bce245b8c302aca29b9e4a11957b6d345d42fd61256ce5d1e3e2adec
Sep 08 00:08:21.377593 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:21.377547    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2" event={"ID":"22be77bd-6df9-4449-877a-552ace553114","Type":"ContainerStarted","Data":"a4e6cc24bce245b8c302aca29b9e4a11957b6d345d42fd61256ce5d1e3e2adec"}
Sep 08 00:08:21.379397 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:21.379369    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerID="5689dca40f1a0f01dd4708f8bea30ccb1af0e30e0f87aa9c85ac9e77ba2f111d" exitCode=0
Sep 08 00:08:21.379542 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:21.379409    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb" event={"ID":"3f91ed6a-fef4-493e-9103-aac8356d8f3a","Type":"ContainerDied","Data":"5689dca40f1a0f01dd4708f8bea30ccb1af0e30e0f87aa9c85ac9e77ba2f111d"}
Sep 08 00:08:23.394778 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:23.394736    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2" event={"ID":"22be77bd-6df9-4449-877a-552ace553114","Type":"ContainerStarted","Data":"a8c7ccc7abb4fbfd0de9f11a8596209c3807bf36e6ee7399c93c7d5602180038"}
Sep 08 00:08:23.395199 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:23.394963    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:23.410725 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:23.410667    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2" podStartSLOduration=1.6949602449999999 podStartE2EDuration="4.410650075s" totalImagesPullingTime="2.71568983s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:08:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:08:23.410254774 +0000 UTC m=+346.160951621" watchObservedRunningTime="2026-09-08 00:08:23.410650075 +0000 UTC m=+346.161346919"
Sep 08 00:08:25.406427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:25.406383    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerID="c922918f9c5233631010411a2fce8f8778086c553656dd297f46ba060eebc367" exitCode=0
Sep 08 00:08:25.406855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:25.406481    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb" event={"ID":"3f91ed6a-fef4-493e-9103-aac8356d8f3a","Type":"ContainerDied","Data":"c922918f9c5233631010411a2fce8f8778086c553656dd297f46ba060eebc367"}
Sep 08 00:08:26.413356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:26.413325    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerID="a06ee9b02a339b79ce6c6e8d27232b9d9a46e3b1adee9faea652f2a6f851d099" exitCode=0
Sep 08 00:08:26.413748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:26.413403    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb" event={"ID":"3f91ed6a-fef4-493e-9103-aac8356d8f3a","Type":"ContainerDied","Data":"a06ee9b02a339b79ce6c6e8d27232b9d9a46e3b1adee9faea652f2a6f851d099"}
Sep 08 00:08:27.544734 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.544702    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:27.663272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.663239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util\") pod \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") "
Sep 08 00:08:27.663272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.663280    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkjdj\" (UniqueName: \"kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj\") pod \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") "
Sep 08 00:08:27.663572 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.663323    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle\") pod \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\" (UID: \"3f91ed6a-fef4-493e-9103-aac8356d8f3a\") "
Sep 08 00:08:27.663758 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.663727    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle" (OuterVolumeSpecName: "bundle") pod "3f91ed6a-fef4-493e-9103-aac8356d8f3a" (UID: "3f91ed6a-fef4-493e-9103-aac8356d8f3a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:08:27.665501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.665476    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj" (OuterVolumeSpecName: "kube-api-access-tkjdj") pod "3f91ed6a-fef4-493e-9103-aac8356d8f3a" (UID: "3f91ed6a-fef4-493e-9103-aac8356d8f3a"). InnerVolumeSpecName "kube-api-access-tkjdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:08:27.667589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.667568    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util" (OuterVolumeSpecName: "util") pod "3f91ed6a-fef4-493e-9103-aac8356d8f3a" (UID: "3f91ed6a-fef4-493e-9103-aac8356d8f3a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:08:27.764095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.764034    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkjdj\" (UniqueName: \"kubernetes.io/projected/3f91ed6a-fef4-493e-9103-aac8356d8f3a-kube-api-access-tkjdj\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:27.764095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.764085    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:27.764095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:27.764095    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f91ed6a-fef4-493e-9103-aac8356d8f3a-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:08:28.423604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:28.423576    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb"
Sep 08 00:08:28.423604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:28.423583    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f8qrtb" event={"ID":"3f91ed6a-fef4-493e-9103-aac8356d8f3a","Type":"ContainerDied","Data":"9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e"}
Sep 08 00:08:28.423815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:28.423655    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9292dce10cbe42307d4e538001bf2fd6d80751258e451b8520abd94d4a97356e"
Sep 08 00:08:29.257552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257521    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2ztpx"]
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257791    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="util"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257803    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="util"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257818    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="extract"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257825    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="extract"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257839    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="pull"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257844    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="pull"
Sep 08 00:08:29.257945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.257893    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f91ed6a-fef4-493e-9103-aac8356d8f3a" containerName="extract"
Sep 08 00:08:29.262014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.261994    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.263867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.263844    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dk9pz\""
Sep 08 00:08:29.270235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.270209    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2ztpx"]
Sep 08 00:08:29.378011 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.377975    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-bound-sa-token\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.378011 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.378016    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxddd\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-kube-api-access-vxddd\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.403013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.402990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-wwdd2"
Sep 08 00:08:29.478973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.478933    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-bound-sa-token\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.478973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.478985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxddd\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-kube-api-access-vxddd\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.486349 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.486318    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-bound-sa-token\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.486509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.486464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxddd\" (UniqueName: \"kubernetes.io/projected/6a507861-c0f8-4c8f-be52-57bb41dfda73-kube-api-access-vxddd\") pod \"cert-manager-55b4d954d5-2ztpx\" (UID: \"6a507861-c0f8-4c8f-be52-57bb41dfda73\") " pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.571319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.571222    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-2ztpx"
Sep 08 00:08:29.844339 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:29.844232    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-2ztpx"]
Sep 08 00:08:29.847329 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:08:29.847301    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a507861_c0f8_4c8f_be52_57bb41dfda73.slice/crio-cee334ad921f49ba169d8cb10746f20291d749d9deeb8b2312cbd405aede2f43 WatchSource:0}: Error finding container cee334ad921f49ba169d8cb10746f20291d749d9deeb8b2312cbd405aede2f43: Status 404 returned error can't find the container with id cee334ad921f49ba169d8cb10746f20291d749d9deeb8b2312cbd405aede2f43
Sep 08 00:08:30.434427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:30.434391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2ztpx" event={"ID":"6a507861-c0f8-4c8f-be52-57bb41dfda73","Type":"ContainerStarted","Data":"b850f1b457654e977619a358c1477a322f5fefe2922e82eeb5736edc57590800"}
Sep 08 00:08:30.434427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:30.434433    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-2ztpx" event={"ID":"6a507861-c0f8-4c8f-be52-57bb41dfda73","Type":"ContainerStarted","Data":"cee334ad921f49ba169d8cb10746f20291d749d9deeb8b2312cbd405aede2f43"}
Sep 08 00:08:30.448044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:30.447985    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-2ztpx" podStartSLOduration=1.447968334 podStartE2EDuration="1.447968334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:08:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:08:30.447075201 +0000 UTC m=+353.197772047" watchObservedRunningTime="2026-09-08 00:08:30.447968334 +0000 UTC m=+353.198665178"
Sep 08 00:08:59.260238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.260200    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"]
Sep 08 00:08:59.266341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.266323    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.268628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.268600    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:08:59.268761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.268604    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:08:59.269316 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.269302    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6qrrx\""
Sep 08 00:08:59.274219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.274195    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"]
Sep 08 00:08:59.332193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.332151    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7bh\" (UniqueName: \"kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.332371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.332266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.332371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.332306    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.433306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.433263    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.433306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.433308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.433557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.433343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7bh\" (UniqueName: \"kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.433712 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.433690    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.433760 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.433742    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.440409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.440387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7bh\" (UniqueName: \"kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.576521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.576420    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:08:59.844111 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:08:59.844062    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"]
Sep 08 00:08:59.846329 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:08:59.846300    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ab06621_dbb3_42a8_909b_f9bc69193375.slice/crio-a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643 WatchSource:0}: Error finding container a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643: Status 404 returned error can't find the container with id a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643
Sep 08 00:09:00.584149 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:00.584113    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerID="bbc3b3c5e8762a395dd6510f303e6db0dc6844c23c061dfd882dbd1671d92568" exitCode=0
Sep 08 00:09:00.584571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:00.584182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4" event={"ID":"0ab06621-dbb3-42a8-909b-f9bc69193375","Type":"ContainerDied","Data":"bbc3b3c5e8762a395dd6510f303e6db0dc6844c23c061dfd882dbd1671d92568"}
Sep 08 00:09:00.584571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:00.584260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4" event={"ID":"0ab06621-dbb3-42a8-909b-f9bc69193375","Type":"ContainerStarted","Data":"a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643"}
Sep 08 00:09:01.590719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:01.590686    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerID="22b3c63dcc01931017ef3284600040757796a7f7f46c9b23e43751d60dd2bcad" exitCode=0
Sep 08 00:09:01.591114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:01.590772    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4" event={"ID":"0ab06621-dbb3-42a8-909b-f9bc69193375","Type":"ContainerDied","Data":"22b3c63dcc01931017ef3284600040757796a7f7f46c9b23e43751d60dd2bcad"}
Sep 08 00:09:02.598652 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:02.598611    2580 generic.go:356] "Generic (PLEG): container finished" podID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerID="114107fb87e5b2b307349c4c4f7e7e7ea932fa76cbd4e13485854862b321f9cb" exitCode=0
Sep 08 00:09:02.599058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:02.598706    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4" event={"ID":"0ab06621-dbb3-42a8-909b-f9bc69193375","Type":"ContainerDied","Data":"114107fb87e5b2b307349c4c4f7e7e7ea932fa76cbd4e13485854862b321f9cb"}
Sep 08 00:09:03.727980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.727954    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:09:03.871786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.871690    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ws7bh\" (UniqueName: \"kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh\") pod \"0ab06621-dbb3-42a8-909b-f9bc69193375\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") "
Sep 08 00:09:03.871786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.871751    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle\") pod \"0ab06621-dbb3-42a8-909b-f9bc69193375\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") "
Sep 08 00:09:03.871786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.871771    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util\") pod \"0ab06621-dbb3-42a8-909b-f9bc69193375\" (UID: \"0ab06621-dbb3-42a8-909b-f9bc69193375\") "
Sep 08 00:09:03.872417 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.872393    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle" (OuterVolumeSpecName: "bundle") pod "0ab06621-dbb3-42a8-909b-f9bc69193375" (UID: "0ab06621-dbb3-42a8-909b-f9bc69193375"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:09:03.873887 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.873864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh" (OuterVolumeSpecName: "kube-api-access-ws7bh") pod "0ab06621-dbb3-42a8-909b-f9bc69193375" (UID: "0ab06621-dbb3-42a8-909b-f9bc69193375"). InnerVolumeSpecName "kube-api-access-ws7bh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:09:03.877122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.877086    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util" (OuterVolumeSpecName: "util") pod "0ab06621-dbb3-42a8-909b-f9bc69193375" (UID: "0ab06621-dbb3-42a8-909b-f9bc69193375"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:09:03.973018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.972978    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7bh\" (UniqueName: \"kubernetes.io/projected/0ab06621-dbb3-42a8-909b-f9bc69193375-kube-api-access-ws7bh\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:03.973018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.973012    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:03.973018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:03.973021    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0ab06621-dbb3-42a8-909b-f9bc69193375-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:04.609510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:04.609477    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4"
Sep 08 00:09:04.609775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:04.609480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af9fgd4" event={"ID":"0ab06621-dbb3-42a8-909b-f9bc69193375","Type":"ContainerDied","Data":"a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643"}
Sep 08 00:09:04.609775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:04.609605    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a77891ec361d7f6f7a8664f8baf3d8bd2e3555e1ecba45ffeb42ae84c3368643"
Sep 08 00:09:08.225766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.225725    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-58d5ddb876-pn6j9"]
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226018    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="util"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226029    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="util"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226039    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="extract"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226045    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="extract"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226060    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="pull"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226066    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="pull"
Sep 08 00:09:08.226209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.226115    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ab06621-dbb3-42a8-909b-f9bc69193375" containerName="extract"
Sep 08 00:09:08.229656 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.229629    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.238123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.238089    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d5ddb876-pn6j9"]
Sep 08 00:09:08.308684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-trusted-ca-bundle\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.308684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308690    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.308940 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-oauth-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.308940 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308824    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-oauth-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.308940 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308844    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.308940 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308926    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-service-ca\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.309089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.308945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqw4q\" (UniqueName: \"kubernetes.io/projected/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-kube-api-access-bqw4q\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410055    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-oauth-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410098    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410137    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-service-ca\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410160    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqw4q\" (UniqueName: \"kubernetes.io/projected/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-kube-api-access-bqw4q\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-trusted-ca-bundle\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410237    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.410356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.410276    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-oauth-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.411106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.411074    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.411233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.411112    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-service-ca\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.411233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.411152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-oauth-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.411357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.411328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-trusted-ca-bundle\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.412692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.412663    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-oauth-config\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.412796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.412777    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-console-serving-cert\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.417169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.417144    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqw4q\" (UniqueName: \"kubernetes.io/projected/e702ff97-e1ac-4011-b6f7-9ecb3f03eea2-kube-api-access-bqw4q\") pod \"console-58d5ddb876-pn6j9\" (UID: \"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2\") " pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.541066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.540971    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:08.811915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:08.811891    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-58d5ddb876-pn6j9"]
Sep 08 00:09:08.813978 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:08.813950    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode702ff97_e1ac_4011_b6f7_9ecb3f03eea2.slice/crio-fcb3f9c6273919fe8b6b249898f0cb2a0f382ced2ee112739f1c41310ffee2fc WatchSource:0}: Error finding container fcb3f9c6273919fe8b6b249898f0cb2a0f382ced2ee112739f1c41310ffee2fc: Status 404 returned error can't find the container with id fcb3f9c6273919fe8b6b249898f0cb2a0f382ced2ee112739f1c41310ffee2fc
Sep 08 00:09:09.634508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:09.634444    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d5ddb876-pn6j9" event={"ID":"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2","Type":"ContainerStarted","Data":"87eb6d871ef48fa0f3a26b59319d0c084d305c795f35abcee325bea8dccc6adc"}
Sep 08 00:09:09.634918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:09.634527    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-58d5ddb876-pn6j9" event={"ID":"e702ff97-e1ac-4011-b6f7-9ecb3f03eea2","Type":"ContainerStarted","Data":"fcb3f9c6273919fe8b6b249898f0cb2a0f382ced2ee112739f1c41310ffee2fc"}
Sep 08 00:09:09.652428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:09.652368    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-58d5ddb876-pn6j9" podStartSLOduration=1.652349812 podStartE2EDuration="1.652349812s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:09.651068044 +0000 UTC m=+392.401764891" watchObservedRunningTime="2026-09-08 00:09:09.652349812 +0000 UTC m=+392.403046656"
Sep 08 00:09:13.513173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.513125    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"]
Sep 08 00:09:13.516939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.516910    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.519049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.519025    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:09:13.519680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.519657    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6qrrx\""
Sep 08 00:09:13.519680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.519675    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:09:13.524098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.524052    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"]
Sep 08 00:09:13.654218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.654177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f6xv\" (UniqueName: \"kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.654414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.654237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.654414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.654348    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.754846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.754803    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.755051 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.754863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f6xv\" (UniqueName: \"kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.755051 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.754916    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.755307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.755286    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.755374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.755310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.766551 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.766472    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f6xv\" (UniqueName: \"kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:13.827021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:13.826985    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:14.105201 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:14.105098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"]
Sep 08 00:09:14.109165 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:14.109126    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0664b4c_029d_48c1_995e_4ba5e976fe2b.slice/crio-d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895 WatchSource:0}: Error finding container d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895: Status 404 returned error can't find the container with id d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895
Sep 08 00:09:14.660881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:14.660845    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerID="39ebac37ec6844b321308deb054caaf83fd6a9cbaed692cc7a4f97b41dac88e5" exitCode=0
Sep 08 00:09:14.661302 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:14.660886    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4" event={"ID":"f0664b4c-029d-48c1-995e-4ba5e976fe2b","Type":"ContainerDied","Data":"39ebac37ec6844b321308deb054caaf83fd6a9cbaed692cc7a4f97b41dac88e5"}
Sep 08 00:09:14.661302 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:14.660925    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4" event={"ID":"f0664b4c-029d-48c1-995e-4ba5e976fe2b","Type":"ContainerStarted","Data":"d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895"}
Sep 08 00:09:15.112772 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.112735    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"]
Sep 08 00:09:15.116096 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.116076    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.119631 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.119602    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-flzw7\""
Sep 08 00:09:15.120306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.120255    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 00:09:15.120306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.120275    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 00:09:15.120306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.120304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 00:09:15.125028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.125005    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 00:09:15.139792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.139757    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"]
Sep 08 00:09:15.266133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.266087    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.266313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.266142    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.266313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.266163    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.266313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.266187    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgdfq\" (UniqueName: \"kubernetes.io/projected/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-kube-api-access-pgdfq\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.266313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.266282    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.367387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.367286    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.367387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.367332    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.367723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.367553    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgdfq\" (UniqueName: \"kubernetes.io/projected/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-kube-api-access-pgdfq\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.367723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.367667    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.367850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.367725    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.368022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.368000    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-manifests\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.370033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.370004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-webhook-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.370166 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.370004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.370235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.370176    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-tmp\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.375241 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.375214    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgdfq\" (UniqueName: \"kubernetes.io/projected/6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0-kube-api-access-pgdfq\") pod \"opendatahub-operator-controller-manager-57cf67b67f-rd9p8\" (UID: \"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0\") " pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.427966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.427912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:15.667707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.667615    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerID="bfef35b6f6f733670796d6825e0e305e16a9f33be9b4cb61df40fbbdc7817986" exitCode=0
Sep 08 00:09:15.668087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.667699    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4" event={"ID":"f0664b4c-029d-48c1-995e-4ba5e976fe2b","Type":"ContainerDied","Data":"bfef35b6f6f733670796d6825e0e305e16a9f33be9b4cb61df40fbbdc7817986"}
Sep 08 00:09:15.706268 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:15.706242    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"]
Sep 08 00:09:15.708663 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:15.708628    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1c1bd4_9b9e_4d6c_bbdb_d2b32f1f16d0.slice/crio-55ae4f9af9ff738bbe051f5fe34f21993a9c8708fd0ce6330530d08c9d3ea6d3 WatchSource:0}: Error finding container 55ae4f9af9ff738bbe051f5fe34f21993a9c8708fd0ce6330530d08c9d3ea6d3: Status 404 returned error can't find the container with id 55ae4f9af9ff738bbe051f5fe34f21993a9c8708fd0ce6330530d08c9d3ea6d3
Sep 08 00:09:16.679445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:16.679399    2580 generic.go:356] "Generic (PLEG): container finished" podID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerID="a12491dea60cfebdc1a7954bd7544266ead5a68dc728699040d503015939a47d" exitCode=0
Sep 08 00:09:16.679926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:16.679518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4" event={"ID":"f0664b4c-029d-48c1-995e-4ba5e976fe2b","Type":"ContainerDied","Data":"a12491dea60cfebdc1a7954bd7544266ead5a68dc728699040d503015939a47d"}
Sep 08 00:09:16.681904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:16.681821    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8" event={"ID":"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0","Type":"ContainerStarted","Data":"55ae4f9af9ff738bbe051f5fe34f21993a9c8708fd0ce6330530d08c9d3ea6d3"}
Sep 08 00:09:18.541428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.541306    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:18.541428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.541392    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:18.546766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.546734    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:18.696837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.696807    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-58d5ddb876-pn6j9"
Sep 08 00:09:18.711567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.711538    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:18.766231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.766200    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:09:18.802612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.802573    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util\") pod \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") "
Sep 08 00:09:18.802756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.802629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle\") pod \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") "
Sep 08 00:09:18.802756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.802723    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f6xv\" (UniqueName: \"kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv\") pod \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\" (UID: \"f0664b4c-029d-48c1-995e-4ba5e976fe2b\") "
Sep 08 00:09:18.803782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.803735    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle" (OuterVolumeSpecName: "bundle") pod "f0664b4c-029d-48c1-995e-4ba5e976fe2b" (UID: "f0664b4c-029d-48c1-995e-4ba5e976fe2b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:09:18.806050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.806014    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv" (OuterVolumeSpecName: "kube-api-access-8f6xv") pod "f0664b4c-029d-48c1-995e-4ba5e976fe2b" (UID: "f0664b4c-029d-48c1-995e-4ba5e976fe2b"). InnerVolumeSpecName "kube-api-access-8f6xv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:09:18.809425 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.808919    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util" (OuterVolumeSpecName: "util") pod "f0664b4c-029d-48c1-995e-4ba5e976fe2b" (UID: "f0664b4c-029d-48c1-995e-4ba5e976fe2b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:09:18.904175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.904135    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f6xv\" (UniqueName: \"kubernetes.io/projected/f0664b4c-029d-48c1-995e-4ba5e976fe2b-kube-api-access-8f6xv\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:18.904175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.904165    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:18.904175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:18.904177    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f0664b4c-029d-48c1-995e-4ba5e976fe2b-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:19.698970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:19.698930    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4" event={"ID":"f0664b4c-029d-48c1-995e-4ba5e976fe2b","Type":"ContainerDied","Data":"d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895"}
Sep 08 00:09:19.699407 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:19.699012    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d5283bb2f83da61cdf107240329ad8a943581df24fd9b93a69a412afb45d6895"
Sep 08 00:09:19.699407 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:19.698944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0sfxf4"
Sep 08 00:09:19.700769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:19.700728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8" event={"ID":"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0","Type":"ContainerStarted","Data":"9fd079b12c6e7f670f2c3c6c46d444417c757a28256bd3e54bc9415f12f3d46c"}
Sep 08 00:09:20.707640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:20.707602    2580 generic.go:356] "Generic (PLEG): container finished" podID="6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0" containerID="9fd079b12c6e7f670f2c3c6c46d444417c757a28256bd3e54bc9415f12f3d46c" exitCode=0
Sep 08 00:09:20.708041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:20.707669    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8" event={"ID":"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0","Type":"ContainerDied","Data":"9fd079b12c6e7f670f2c3c6c46d444417c757a28256bd3e54bc9415f12f3d46c"}
Sep 08 00:09:21.715936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:21.715902    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8" event={"ID":"6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0","Type":"ContainerStarted","Data":"b915ff6ec77a5b87d092afbad78272e841322160560e8e4ea91f181a5855fc81"}
Sep 08 00:09:21.716408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:21.716013    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:21.736647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:21.736588    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8" podStartSLOduration=2.292348999 podStartE2EDuration="6.736569387s" totalImagesPullingTime="3.350326958s" totalInitContainerRuntime="1.09389343s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:21.734341929 +0000 UTC m=+404.485038770" watchObservedRunningTime="2026-09-08 00:09:21.736569387 +0000 UTC m=+404.487266231"
Sep 08 00:09:32.723600 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:32.723567    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-57cf67b67f-rd9p8"
Sep 08 00:09:34.807968 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.807930    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"]
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808242    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="util"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808253    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="util"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808263    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="pull"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808268    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="pull"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808274    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="extract"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808280    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="extract"
Sep 08 00:09:34.808372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.808330    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0664b4c-029d-48c1-995e-4ba5e976fe2b" containerName="extract"
Sep 08 00:09:34.869001 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.868964    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"]
Sep 08 00:09:34.869192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.869087    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:34.871247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.871216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 00:09:34.871623 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.871295    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 00:09:34.871724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.871334    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-v6zxp\""
Sep 08 00:09:34.938464 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.938427    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5snzt\" (UniqueName: \"kubernetes.io/projected/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-kube-api-access-5snzt\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:34.938661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.938502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tmp\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:34.938661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:34.938533    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.039396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.039354    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5snzt\" (UniqueName: \"kubernetes.io/projected/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-kube-api-access-5snzt\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.039396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.039405    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tmp\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.039660 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.039430    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.039660 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:35.039568    2580 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 08 00:09:35.039660 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:35.039627    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs podName:23d0a6c1-5d40-4329-b37d-7ca6cfd9f540 nodeName:}" failed. No retries permitted until 2026-09-08 00:09:35.539611634 +0000 UTC m=+418.290308456 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs") pod "kube-auth-proxy-b9b857bf8-rvmfw" (UID: "23d0a6c1-5d40-4329-b37d-7ca6cfd9f540") : secret "kube-auth-proxy-tls" not found
Sep 08 00:09:35.041748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.041711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tmp\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.049949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.049914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5snzt\" (UniqueName: \"kubernetes.io/projected/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-kube-api-access-5snzt\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.543532 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.543490    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.546352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.546319    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23d0a6c1-5d40-4329-b37d-7ca6cfd9f540-tls-certs\") pod \"kube-auth-proxy-b9b857bf8-rvmfw\" (UID: \"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540\") " pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:35.779542 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:35.779508    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"
Sep 08 00:09:36.037090 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.037059    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:36.040632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.040609    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.042785 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.042748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 00:09:36.042926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.042748    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 00:09:36.043123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.043093    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 00:09:36.043123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.043112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7s5pn\""
Sep 08 00:09:36.043435 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.043414    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 00:09:36.048409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048379    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048585 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048477    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048613    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048697    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048759    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.048993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.048783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc5qw\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.052722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.052696    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:36.054647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.054620    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw"]
Sep 08 00:09:36.057329 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:36.057304    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d0a6c1_5d40_4329_b37d_7ca6cfd9f540.slice/crio-0c6aae095976a7612c9d8ae646aa967ff5c3d70e5287764357a9a76f32f0aa02 WatchSource:0}: Error finding container 0c6aae095976a7612c9d8ae646aa967ff5c3d70e5287764357a9a76f32f0aa02: Status 404 returned error can't find the container with id 0c6aae095976a7612c9d8ae646aa967ff5c3d70e5287764357a9a76f32f0aa02
Sep 08 00:09:36.149708 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149768    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149791    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149814    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149832    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.149878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.149857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc5qw\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.150514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.150482    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.152273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.152246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.152485 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.152439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.152750 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.152729    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.152862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.152836    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.156783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.156752    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.157115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.157093    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc5qw\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw\") pod \"istiod-openshift-gateway-7b7995d5cd-rqhvs\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.352476 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.352404    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:36.633880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.633842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:36.636023 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:36.635995    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod292a8251_8861_4f6f_8db5_785d6b1da918.slice/crio-26600ba7588366664a4199231bca871cda4b29205a616e1ed8f9b98d897384f7 WatchSource:0}: Error finding container 26600ba7588366664a4199231bca871cda4b29205a616e1ed8f9b98d897384f7: Status 404 returned error can't find the container with id 26600ba7588366664a4199231bca871cda4b29205a616e1ed8f9b98d897384f7
Sep 08 00:09:36.790699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.790654    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" event={"ID":"292a8251-8861-4f6f-8db5-785d6b1da918","Type":"ContainerStarted","Data":"26600ba7588366664a4199231bca871cda4b29205a616e1ed8f9b98d897384f7"}
Sep 08 00:09:36.792309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:36.792231    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw" event={"ID":"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540","Type":"ContainerStarted","Data":"0c6aae095976a7612c9d8ae646aa967ff5c3d70e5287764357a9a76f32f0aa02"}
Sep 08 00:09:38.792878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:38.792849    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 00:09:39.810990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:39.810933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw" event={"ID":"23d0a6c1-5d40-4329-b37d-7ca6cfd9f540","Type":"ContainerStarted","Data":"f422024b3a5379e170526f6f958c1c628102fcfe8688556650d4eaff298c1f8a"}
Sep 08 00:09:39.825681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:39.825615    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b9b857bf8-rvmfw" podStartSLOduration=3.094839541 podStartE2EDuration="5.825592746s" totalImagesPullingTime="2.730753205s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:39.824122271 +0000 UTC m=+422.574819137" watchObservedRunningTime="2026-09-08 00:09:39.825592746 +0000 UTC m=+422.576289589"
Sep 08 00:09:40.745207 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:40.745163    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:09:40.745305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:40.745235    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:09:40.817864 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:40.817818    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" event={"ID":"292a8251-8861-4f6f-8db5-785d6b1da918","Type":"ContainerStarted","Data":"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"}
Sep 08 00:09:40.818313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:40.818127    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:40.836167 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:40.836110    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" podStartSLOduration=0.730014413 podStartE2EDuration="4.836092471s" totalImagesPullingTime="4.106078058s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:40.834023547 +0000 UTC m=+423.584720392" watchObservedRunningTime="2026-09-08 00:09:40.836092471 +0000 UTC m=+423.586789314"
Sep 08 00:09:41.825753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:41.825713    2580 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-rqhvs container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:09:41.826201 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:41.825812    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:09:42.506181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.506145    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"]
Sep 08 00:09:42.509714 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.509681    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.511942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.511909    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7xmhw\""
Sep 08 00:09:42.521194 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.521161    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"]
Sep 08 00:09:42.611334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611356    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611435    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lk92\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-kube-api-access-5lk92\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d515462-77ef-49b9-913a-2e8022f38b37-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611556 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611556    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611575    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d515462-77ef-49b9-913a-2e8022f38b37-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611639    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.611707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.611654    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.712834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712794    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lk92\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-kube-api-access-5lk92\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.712834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712841    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d515462-77ef-49b9-913a-2e8022f38b37-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712884    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712904    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712925    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d515462-77ef-49b9-913a-2e8022f38b37-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712950    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.712975    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713003    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713352    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713546    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713655 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713603    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713655 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.713756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.713728    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0d515462-77ef-49b9-913a-2e8022f38b37-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.715371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.715347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0d515462-77ef-49b9-913a-2e8022f38b37-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.715701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.715679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0d515462-77ef-49b9-913a-2e8022f38b37-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.722565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.722536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.722722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.722703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lk92\" (UniqueName: \"kubernetes.io/projected/0d515462-77ef-49b9-913a-2e8022f38b37-kube-api-access-5lk92\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x\" (UID: \"0d515462-77ef-49b9-913a-2e8022f38b37\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:42.823161 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:42.823049    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:43.110214 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:43.110185    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"]
Sep 08 00:09:43.112704 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:43.112670    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d515462_77ef_49b9_913a_2e8022f38b37.slice/crio-97e47ae04af1e8277876feed9acff3096c3ec5ba89c8e2480469d47c6c922764 WatchSource:0}: Error finding container 97e47ae04af1e8277876feed9acff3096c3ec5ba89c8e2480469d47c6c922764: Status 404 returned error can't find the container with id 97e47ae04af1e8277876feed9acff3096c3ec5ba89c8e2480469d47c6c922764
Sep 08 00:09:43.794308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:43.794234    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55cc77ff7b-87vbg" podUID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" containerName="console" containerID="cri-o://c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b" gracePeriod=15
Sep 08 00:09:43.834778 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:43.834728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x" event={"ID":"0d515462-77ef-49b9-913a-2e8022f38b37","Type":"ContainerStarted","Data":"97e47ae04af1e8277876feed9acff3096c3ec5ba89c8e2480469d47c6c922764"}
Sep 08 00:09:44.047302 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.047224    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:09:44.125939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.125899    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.125939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.125942    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.125972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126041    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126105    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wrrz9\" (UniqueName: \"kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert\") pod \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\" (UID: \"07a7bdc3-1313-47d3-9390-d84cebfa37f9\") "
Sep 08 00:09:44.126471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126426    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca" (OuterVolumeSpecName: "service-ca") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:09:44.126788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126571    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:09:44.126788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126591    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config" (OuterVolumeSpecName: "console-config") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:09:44.126788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.126607    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:09:44.128433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.128406    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:09:44.128573 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.128436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:09:44.128573 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.128482    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9" (OuterVolumeSpecName: "kube-api-access-wrrz9") pod "07a7bdc3-1313-47d3-9390-d84cebfa37f9" (UID: "07a7bdc3-1313-47d3-9390-d84cebfa37f9"). InnerVolumeSpecName "kube-api-access-wrrz9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:09:44.227249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227207    2580 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-oauth-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227243    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wrrz9\" (UniqueName: \"kubernetes.io/projected/07a7bdc3-1313-47d3-9390-d84cebfa37f9-kube-api-access-wrrz9\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227253    2580 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-serving-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227263    2580 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227272    2580 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227280    2580 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/07a7bdc3-1313-47d3-9390-d84cebfa37f9-console-oauth-config\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.227531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.227290    2580 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/07a7bdc3-1313-47d3-9390-d84cebfa37f9-trusted-ca-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:44.824617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.824584    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:44.840699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.840537    2580 generic.go:356] "Generic (PLEG): container finished" podID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" containerID="c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b" exitCode=0
Sep 08 00:09:44.840699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.840613    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55cc77ff7b-87vbg"
Sep 08 00:09:44.840699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.840680    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc77ff7b-87vbg" event={"ID":"07a7bdc3-1313-47d3-9390-d84cebfa37f9","Type":"ContainerDied","Data":"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"}
Sep 08 00:09:44.841089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.840732    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55cc77ff7b-87vbg" event={"ID":"07a7bdc3-1313-47d3-9390-d84cebfa37f9","Type":"ContainerDied","Data":"8ca27ac79d8fdb3d83d692d3d1e5251599492547a280a20fa1bc69774c7aa8ad"}
Sep 08 00:09:44.841089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.840760    2580 scope.go:117] "RemoveContainer" containerID="c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"
Sep 08 00:09:44.850615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.850589    2580 scope.go:117] "RemoveContainer" containerID="c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"
Sep 08 00:09:44.851021 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:44.850990    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b\": container with ID starting with c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b not found: ID does not exist" containerID="c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"
Sep 08 00:09:44.851111 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.851035    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b"} err="failed to get container status \"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b\": rpc error: code = NotFound desc = could not find container \"c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b\": container with ID starting with c5c26055cfeb083fa45ad8d0a90ec6a0b9f14bf0e3149e0c04014f252a1d3b4b not found: ID does not exist"
Sep 08 00:09:44.862268 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.862222    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:09:44.868530 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:44.868496    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55cc77ff7b-87vbg"]
Sep 08 00:09:45.778393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:45.778351    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" path="/var/lib/kubelet/pods/07a7bdc3-1313-47d3-9390-d84cebfa37f9/volumes"
Sep 08 00:09:46.576715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:46.576664    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:09:46.576858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:46.576750    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:09:46.576858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:46.576780    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:09:46.858372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:46.858260    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x" event={"ID":"0d515462-77ef-49b9-913a-2e8022f38b37","Type":"ContainerStarted","Data":"36ba5efa5189c8ab3ee3f697c879b12d4c20602e346cf049ae07bae5019259e6"}
Sep 08 00:09:46.877436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:46.877365    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x" podStartSLOduration=1.416395353 podStartE2EDuration="4.87734087s" totalImagesPullingTime="3.460945517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:46.874261918 +0000 UTC m=+429.624958798" watchObservedRunningTime="2026-09-08 00:09:46.87734087 +0000 UTC m=+429.628037716"
Sep 08 00:09:47.823663 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:47.823620    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:47.829183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:47.829148    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:47.864032 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:47.863990    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:47.865066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:47.865044    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x"
Sep 08 00:09:55.209634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.209600    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"]
Sep 08 00:09:55.210041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.209917    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" containerName="console"
Sep 08 00:09:55.210041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.209929    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" containerName="console"
Sep 08 00:09:55.210041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.209994    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a7bdc3-1313-47d3-9390-d84cebfa37f9" containerName="console"
Sep 08 00:09:55.214540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.214514    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.216796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.216761    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 08 00:09:55.216796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.216770    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-wvlsl\""
Sep 08 00:09:55.222116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.222086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"]
Sep 08 00:09:55.226788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.226752    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"]
Sep 08 00:09:55.226947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.226875    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.229292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.229264    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-rb7jz\""
Sep 08 00:09:55.229412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.229354    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 00:09:55.234181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.234150    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"]
Sep 08 00:09:55.338353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.338313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a2f3a36-d03a-4882-a28a-df0e214b90a9-cert\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.338564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.338377    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxhxb\" (UniqueName: \"kubernetes.io/projected/9a2f3a36-d03a-4882-a28a-df0e214b90a9-kube-api-access-lxhxb\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.338564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.338505    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.338695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.338598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtcln\" (UniqueName: \"kubernetes.io/projected/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-kube-api-access-mtcln\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.439870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.439823    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxhxb\" (UniqueName: \"kubernetes.io/projected/9a2f3a36-d03a-4882-a28a-df0e214b90a9-kube-api-access-lxhxb\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.439870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.439881    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.440142 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.439923    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtcln\" (UniqueName: \"kubernetes.io/projected/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-kube-api-access-mtcln\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.440142 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.439951    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a2f3a36-d03a-4882-a28a-df0e214b90a9-cert\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.440142 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:55.440054    2580 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 08 00:09:55.440299 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:55.440149    2580 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert podName:33e0f70c-ea3d-42f2-aeec-53ceec2b04b8 nodeName:}" failed. No retries permitted until 2026-09-08 00:09:55.940124657 +0000 UTC m=+438.690821494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert") pod "llmisvc-controller-manager-777c6bd7d5-rh4px" (UID: "33e0f70c-ea3d-42f2-aeec-53ceec2b04b8") : secret "llmisvc-webhook-server-cert" not found
Sep 08 00:09:55.442399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.442369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9a2f3a36-d03a-4882-a28a-df0e214b90a9-cert\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.448330 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.448298    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxhxb\" (UniqueName: \"kubernetes.io/projected/9a2f3a36-d03a-4882-a28a-df0e214b90a9-kube-api-access-lxhxb\") pod \"kserve-controller-manager-d6f4b65b8-w8xl4\" (UID: \"9a2f3a36-d03a-4882-a28a-df0e214b90a9\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.449014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.448994    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtcln\" (UniqueName: \"kubernetes.io/projected/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-kube-api-access-mtcln\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.528524 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.528475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:55.829030 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.829003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"]
Sep 08 00:09:55.831928 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:55.831898    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2f3a36_d03a_4882_a28a_df0e214b90a9.slice/crio-a3c06de34f36b01e8541a1628e56acf55d65f824f05e2190f7299a22ee6814d7 WatchSource:0}: Error finding container a3c06de34f36b01e8541a1628e56acf55d65f824f05e2190f7299a22ee6814d7: Status 404 returned error can't find the container with id a3c06de34f36b01e8541a1628e56acf55d65f824f05e2190f7299a22ee6814d7
Sep 08 00:09:55.907707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.907667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4" event={"ID":"9a2f3a36-d03a-4882-a28a-df0e214b90a9","Type":"ContainerStarted","Data":"a3c06de34f36b01e8541a1628e56acf55d65f824f05e2190f7299a22ee6814d7"}
Sep 08 00:09:55.944945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.944910    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:55.947384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:55.947359    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/33e0f70c-ea3d-42f2-aeec-53ceec2b04b8-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-rh4px\" (UID: \"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:56.141671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:56.141576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:56.415056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:56.414875    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"]
Sep 08 00:09:56.417802 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:09:56.417769    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33e0f70c_ea3d_42f2_aeec_53ceec2b04b8.slice/crio-daa28c101342e69cb11b9af76f4098168cd7ee50d7452b3170f507591ea6ce5d WatchSource:0}: Error finding container daa28c101342e69cb11b9af76f4098168cd7ee50d7452b3170f507591ea6ce5d: Status 404 returned error can't find the container with id daa28c101342e69cb11b9af76f4098168cd7ee50d7452b3170f507591ea6ce5d
Sep 08 00:09:56.916344 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:56.916306    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px" event={"ID":"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8","Type":"ContainerStarted","Data":"daa28c101342e69cb11b9af76f4098168cd7ee50d7452b3170f507591ea6ce5d"}
Sep 08 00:09:58.123045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.122999    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:58.123580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.123247    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" containerName="discovery" containerID="cri-o://96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7" gracePeriod=30
Sep 08 00:09:58.559419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.559389    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:58.672098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.671979    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672031    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672079    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672118    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672162    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672231    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc5qw\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672286    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig\") pod \"292a8251-8861-4f6f-8db5-785d6b1da918\" (UID: \"292a8251-8861-4f6f-8db5-785d6b1da918\") "
Sep 08 00:09:58.672822 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.672774    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:09:58.675253 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675140    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:09:58.675253 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675215    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw" (OuterVolumeSpecName: "kube-api-access-wc5qw") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "kube-api-access-wc5qw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:09:58.675589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675554    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token" (OuterVolumeSpecName: "istio-token") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:09:58.675589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675566    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs" (OuterVolumeSpecName: "local-certs") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:09:58.675847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675796    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:09:58.675924 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.675885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts" (OuterVolumeSpecName: "cacerts") pod "292a8251-8861-4f6f-8db5-785d6b1da918" (UID: "292a8251-8861-4f6f-8db5-785d6b1da918"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:09:58.773289 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773245    2580 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-cacerts\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773289 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773288    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc5qw\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-kube-api-access-wc5qw\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773304    2580 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-kubeconfig\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773321    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-dns-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773331    2580 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/292a8251-8861-4f6f-8db5-785d6b1da918-istio-csr-ca-configmap\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773340    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/292a8251-8861-4f6f-8db5-785d6b1da918-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.773543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.773352    2580 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/292a8251-8861-4f6f-8db5-785d6b1da918-local-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:09:58.931123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.931027    2580 generic.go:356] "Generic (PLEG): container finished" podID="292a8251-8861-4f6f-8db5-785d6b1da918" containerID="96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7" exitCode=0
Sep 08 00:09:58.931123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.931081    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"
Sep 08 00:09:58.931341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.931125    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" event={"ID":"292a8251-8861-4f6f-8db5-785d6b1da918","Type":"ContainerDied","Data":"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"}
Sep 08 00:09:58.931341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.931182    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs" event={"ID":"292a8251-8861-4f6f-8db5-785d6b1da918","Type":"ContainerDied","Data":"26600ba7588366664a4199231bca871cda4b29205a616e1ed8f9b98d897384f7"}
Sep 08 00:09:58.931341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.931209    2580 scope.go:117] "RemoveContainer" containerID="96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"
Sep 08 00:09:58.954022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.953961    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:58.956314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:58.956279    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rqhvs"]
Sep 08 00:09:59.099959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.099934    2580 scope.go:117] "RemoveContainer" containerID="96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"
Sep 08 00:09:59.100343 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:09:59.100318    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7\": container with ID starting with 96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7 not found: ID does not exist" containerID="96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"
Sep 08 00:09:59.100433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.100352    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7"} err="failed to get container status \"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7\": rpc error: code = NotFound desc = could not find container \"96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7\": container with ID starting with 96b36aa1249a01726c0211fd43942bcaf40395e1434e508afb8151e6770837f7 not found: ID does not exist"
Sep 08 00:09:59.778084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.778045    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" path="/var/lib/kubelet/pods/292a8251-8861-4f6f-8db5-785d6b1da918/volumes"
Sep 08 00:09:59.938761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.938678    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4" event={"ID":"9a2f3a36-d03a-4882-a28a-df0e214b90a9","Type":"ContainerStarted","Data":"47fcd50f4e190a4fa895dee91db84557f0c0a082edc7f92bc745058d02470ae9"}
Sep 08 00:09:59.938935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.938806    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:09:59.940402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.940377    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px" event={"ID":"33e0f70c-ea3d-42f2-aeec-53ceec2b04b8","Type":"ContainerStarted","Data":"ceb0c9d512281734170c1a4e8738d3ad49407aeab9ab59923c2fc7ebc9d1ce87"}
Sep 08 00:09:59.940549 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.940525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:09:59.953508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.953431    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4" podStartSLOduration=2.295006865 podStartE2EDuration="4.953415771s" totalImagesPullingTime="2.658408906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:59.952281827 +0000 UTC m=+442.702978673" watchObservedRunningTime="2026-09-08 00:09:59.953415771 +0000 UTC m=+442.704112615"
Sep 08 00:09:59.972241 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:09:59.972184    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px" podStartSLOduration=2.239497221 podStartE2EDuration="4.972164241s" totalImagesPullingTime="2.73266702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:09:59.970804252 +0000 UTC m=+442.721501113" watchObservedRunningTime="2026-09-08 00:09:59.972164241 +0000 UTC m=+442.722861084"
Sep 08 00:10:30.947051 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:30.947018    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-rh4px"
Sep 08 00:10:30.950106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:30.950072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-w8xl4"
Sep 08 00:10:49.574968 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.574934    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"]
Sep 08 00:10:49.575468 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.575282    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" containerName="discovery"
Sep 08 00:10:49.575468 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.575293    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" containerName="discovery"
Sep 08 00:10:49.575468 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.575365    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="292a8251-8861-4f6f-8db5-785d6b1da918" containerName="discovery"
Sep 08 00:10:49.580024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.579997    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.582021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.581993    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 00:10:49.582165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.582123    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6qrrx\""
Sep 08 00:10:49.582765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.582742    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 00:10:49.586075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.586046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"]
Sep 08 00:10:49.673314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.673273    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"]
Sep 08 00:10:49.676817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.676795    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.682960 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.682924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"]
Sep 08 00:10:49.726949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.726905    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.726949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.726951    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.727177 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.727040    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xck8k\" (UniqueName: \"kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.774939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.774904    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"]
Sep 08 00:10:49.778357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.778339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:49.784834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.784801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"]
Sep 08 00:10:49.828409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.828409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.828409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828397    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.828682 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828418    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.828682 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828465    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlqd2\" (UniqueName: \"kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.828682 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828495    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xck8k\" (UniqueName: \"kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.828843 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.828843 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.828835    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.838824 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.838791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xck8k\" (UniqueName: \"kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.875172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.875135    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"]
Sep 08 00:10:49.878883 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.878860    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:49.885292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.885258    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"]
Sep 08 00:10:49.891010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.890975    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:49.929725 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:49.929725 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929691    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj86h\" (UniqueName: \"kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:49.929988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929816    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.929988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlqd2\" (UniqueName: \"kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.929988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929953    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:49.929988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.929982    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.930355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.930248    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.930355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.930270    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.938281 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.938250    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlqd2\" (UniqueName: \"kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:49.987035 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:49.986991    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:50.031076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.030798    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.031076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.030856    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.031076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.030898    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.031076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.030934    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj86h\" (UniqueName: \"kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.031076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.030999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.031503 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.031090    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-297td\" (UniqueName: \"kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.031503 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.031259    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.031503 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.031391    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.038632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.038602    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj86h\" (UniqueName: \"kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.088577 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.088485    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:50.132157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.132118    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.132332 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.132190    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-297td\" (UniqueName: \"kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.132332 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.132253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.132683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.132656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.132827 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.132805    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.141273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.141208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-297td\" (UniqueName: \"kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.170797 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.170682    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"]
Sep 08 00:10:50.171735 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:10:50.171708    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee596106_8366_4b1b_af81_2cba54497ca0.slice/crio-43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919 WatchSource:0}: Error finding container 43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919: Status 404 returned error can't find the container with id 43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919
Sep 08 00:10:50.189379 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.189347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:50.203920 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.203884    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl" event={"ID":"ee596106-8366-4b1b-af81-2cba54497ca0","Type":"ContainerStarted","Data":"43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919"}
Sep 08 00:10:50.270878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.270830    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"]
Sep 08 00:10:50.274116 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:10:50.274076    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67121b94_d99a_45a5_8155_5fd925cda833.slice/crio-773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227 WatchSource:0}: Error finding container 773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227: Status 404 returned error can't find the container with id 773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227
Sep 08 00:10:50.365004 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.364972    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"]
Sep 08 00:10:50.366222 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:10:50.366194    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a4a39e2_0b97_4dd9_9b75_cde620f9140c.slice/crio-860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d WatchSource:0}: Error finding container 860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d: Status 404 returned error can't find the container with id 860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d
Sep 08 00:10:50.468871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:50.468843    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"]
Sep 08 00:10:50.519395 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:10:50.519358    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3a422c_f7b1_4c1f_beea_b2d28ed12f18.slice/crio-8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31 WatchSource:0}: Error finding container 8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31: Status 404 returned error can't find the container with id 8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31
Sep 08 00:10:51.218426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.218392    2580 generic.go:356] "Generic (PLEG): container finished" podID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerID="1399f5ce28e46679e9c040804b8f5fd6b4b0a967eb023aa82d1ebdbb7414b4b7" exitCode=0
Sep 08 00:10:51.218880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.218484    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t" event={"ID":"6a4a39e2-0b97-4dd9-9b75-cde620f9140c","Type":"ContainerDied","Data":"1399f5ce28e46679e9c040804b8f5fd6b4b0a967eb023aa82d1ebdbb7414b4b7"}
Sep 08 00:10:51.218880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.218572    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t" event={"ID":"6a4a39e2-0b97-4dd9-9b75-cde620f9140c","Type":"ContainerStarted","Data":"860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d"}
Sep 08 00:10:51.220349 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.220324    2580 generic.go:356] "Generic (PLEG): container finished" podID="67121b94-d99a-45a5-8155-5fd925cda833" containerID="5a59248588e30876d65004eb2215fff935e0d2ae36420b82193f43972d41c022" exitCode=0
Sep 08 00:10:51.220519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.220413    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb" event={"ID":"67121b94-d99a-45a5-8155-5fd925cda833","Type":"ContainerDied","Data":"5a59248588e30876d65004eb2215fff935e0d2ae36420b82193f43972d41c022"}
Sep 08 00:10:51.220519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.220487    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb" event={"ID":"67121b94-d99a-45a5-8155-5fd925cda833","Type":"ContainerStarted","Data":"773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227"}
Sep 08 00:10:51.222186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.222160    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee596106-8366-4b1b-af81-2cba54497ca0" containerID="8d2e42225179b4454fd8351fd6c1077f12d9a9bc8142e24f0232c724097dcdb6" exitCode=0
Sep 08 00:10:51.222279 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.222229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl" event={"ID":"ee596106-8366-4b1b-af81-2cba54497ca0","Type":"ContainerDied","Data":"8d2e42225179b4454fd8351fd6c1077f12d9a9bc8142e24f0232c724097dcdb6"}
Sep 08 00:10:51.223896 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.223876    2580 generic.go:356] "Generic (PLEG): container finished" podID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerID="2859ed1e21d743d2765a5f2b5417edb671425e70bb732881d62362efc1ee0e4b" exitCode=0
Sep 08 00:10:51.223973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.223954    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerDied","Data":"2859ed1e21d743d2765a5f2b5417edb671425e70bb732881d62362efc1ee0e4b"}
Sep 08 00:10:51.224027 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:51.223999    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerStarted","Data":"8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31"}
Sep 08 00:10:52.232361 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:52.232321    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerStarted","Data":"798a00d248db41a83b4696c462a218a5e6eb387d690a1c90b5746001273fed9f"}
Sep 08 00:10:53.239196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.239161    2580 generic.go:356] "Generic (PLEG): container finished" podID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerID="82f60b5622e8bc7a323e5d306fcf1c51448c3a08abdd8e3edc5806f30fc6f09a" exitCode=0
Sep 08 00:10:53.239706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.239255    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t" event={"ID":"6a4a39e2-0b97-4dd9-9b75-cde620f9140c","Type":"ContainerDied","Data":"82f60b5622e8bc7a323e5d306fcf1c51448c3a08abdd8e3edc5806f30fc6f09a"}
Sep 08 00:10:53.241171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.241150    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee596106-8366-4b1b-af81-2cba54497ca0" containerID="d7fa16719101e18dc630ec7cfdba9b2364822de5ffdf23273a2cb59f545d20d2" exitCode=0
Sep 08 00:10:53.241237 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.241221    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl" event={"ID":"ee596106-8366-4b1b-af81-2cba54497ca0","Type":"ContainerDied","Data":"d7fa16719101e18dc630ec7cfdba9b2364822de5ffdf23273a2cb59f545d20d2"}
Sep 08 00:10:53.243401 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.243380    2580 generic.go:356] "Generic (PLEG): container finished" podID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerID="798a00d248db41a83b4696c462a218a5e6eb387d690a1c90b5746001273fed9f" exitCode=0
Sep 08 00:10:53.243496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:53.243411    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerDied","Data":"798a00d248db41a83b4696c462a218a5e6eb387d690a1c90b5746001273fed9f"}
Sep 08 00:10:54.251664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.251628    2580 generic.go:356] "Generic (PLEG): container finished" podID="ee596106-8366-4b1b-af81-2cba54497ca0" containerID="c12ea4beb1a37c7766eede4c2c170b5fdcfcb3cd8c185ca13990474fe9312676" exitCode=0
Sep 08 00:10:54.252071 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.251718    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl" event={"ID":"ee596106-8366-4b1b-af81-2cba54497ca0","Type":"ContainerDied","Data":"c12ea4beb1a37c7766eede4c2c170b5fdcfcb3cd8c185ca13990474fe9312676"}
Sep 08 00:10:54.253892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.253867    2580 generic.go:356] "Generic (PLEG): container finished" podID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerID="9891ac7db15590811acf2512671113c3edf9efeaec40243c6185e6f3763b974c" exitCode=0
Sep 08 00:10:54.254031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.253947    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerDied","Data":"9891ac7db15590811acf2512671113c3edf9efeaec40243c6185e6f3763b974c"}
Sep 08 00:10:54.255998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.255978    2580 generic.go:356] "Generic (PLEG): container finished" podID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerID="4323f3ee84a95e693da69700e6795c8340e7343a91bab9db44b1ca098cd42685" exitCode=0
Sep 08 00:10:54.256094 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:54.256006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t" event={"ID":"6a4a39e2-0b97-4dd9-9b75-cde620f9140c","Type":"ContainerDied","Data":"4323f3ee84a95e693da69700e6795c8340e7343a91bab9db44b1ca098cd42685"}
Sep 08 00:10:55.457021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.456983    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:55.460629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.460605    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:55.474293 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.474226    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:55.586720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586685    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle\") pod \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") "
Sep 08 00:10:55.586720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586731    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util\") pod \"ee596106-8366-4b1b-af81-2cba54497ca0\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") "
Sep 08 00:10:55.586986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mj86h\" (UniqueName: \"kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h\") pod \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") "
Sep 08 00:10:55.586986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586819    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util\") pod \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\" (UID: \"6a4a39e2-0b97-4dd9-9b75-cde620f9140c\") "
Sep 08 00:10:55.586986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586841    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util\") pod \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") "
Sep 08 00:10:55.586986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xck8k\" (UniqueName: \"kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k\") pod \"ee596106-8366-4b1b-af81-2cba54497ca0\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") "
Sep 08 00:10:55.586986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586928    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle\") pod \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") "
Sep 08 00:10:55.587362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587331    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle" (OuterVolumeSpecName: "bundle") pod "6a4a39e2-0b97-4dd9-9b75-cde620f9140c" (UID: "6a4a39e2-0b97-4dd9-9b75-cde620f9140c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.587544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.586962    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle\") pod \"ee596106-8366-4b1b-af81-2cba54497ca0\" (UID: \"ee596106-8366-4b1b-af81-2cba54497ca0\") "
Sep 08 00:10:55.587623 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587579    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-297td\" (UniqueName: \"kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td\") pod \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\" (UID: \"da3a422c-f7b1-4c1f-beea-b2d28ed12f18\") "
Sep 08 00:10:55.587680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587659    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle" (OuterVolumeSpecName: "bundle") pod "da3a422c-f7b1-4c1f-beea-b2d28ed12f18" (UID: "da3a422c-f7b1-4c1f-beea-b2d28ed12f18"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.587876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587842    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle" (OuterVolumeSpecName: "bundle") pod "ee596106-8366-4b1b-af81-2cba54497ca0" (UID: "ee596106-8366-4b1b-af81-2cba54497ca0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.588007 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587862    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.588007 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.587905    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.589175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.589147    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h" (OuterVolumeSpecName: "kube-api-access-mj86h") pod "6a4a39e2-0b97-4dd9-9b75-cde620f9140c" (UID: "6a4a39e2-0b97-4dd9-9b75-cde620f9140c"). InnerVolumeSpecName "kube-api-access-mj86h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:10:55.589276 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.589175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k" (OuterVolumeSpecName: "kube-api-access-xck8k") pod "ee596106-8366-4b1b-af81-2cba54497ca0" (UID: "ee596106-8366-4b1b-af81-2cba54497ca0"). InnerVolumeSpecName "kube-api-access-xck8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:10:55.589554 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.589535    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td" (OuterVolumeSpecName: "kube-api-access-297td") pod "da3a422c-f7b1-4c1f-beea-b2d28ed12f18" (UID: "da3a422c-f7b1-4c1f-beea-b2d28ed12f18"). InnerVolumeSpecName "kube-api-access-297td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:10:55.592747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.592708    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util" (OuterVolumeSpecName: "util") pod "da3a422c-f7b1-4c1f-beea-b2d28ed12f18" (UID: "da3a422c-f7b1-4c1f-beea-b2d28ed12f18"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.689221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.689177    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.689221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.689215    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xck8k\" (UniqueName: \"kubernetes.io/projected/ee596106-8366-4b1b-af81-2cba54497ca0-kube-api-access-xck8k\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.689221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.689228    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.689502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.689237    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-297td\" (UniqueName: \"kubernetes.io/projected/da3a422c-f7b1-4c1f-beea-b2d28ed12f18-kube-api-access-297td\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.689502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.689246    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mj86h\" (UniqueName: \"kubernetes.io/projected/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-kube-api-access-mj86h\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.886578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.886538    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util" (OuterVolumeSpecName: "util") pod "6a4a39e2-0b97-4dd9-9b75-cde620f9140c" (UID: "6a4a39e2-0b97-4dd9-9b75-cde620f9140c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.887927 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.887903    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util" (OuterVolumeSpecName: "util") pod "ee596106-8366-4b1b-af81-2cba54497ca0" (UID: "ee596106-8366-4b1b-af81-2cba54497ca0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:55.891285 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.891250    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ee596106-8366-4b1b-af81-2cba54497ca0-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:55.891285 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:55.891279    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6a4a39e2-0b97-4dd9-9b75-cde620f9140c-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:56.270266 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.270232    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl" event={"ID":"ee596106-8366-4b1b-af81-2cba54497ca0","Type":"ContainerDied","Data":"43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919"}
Sep 08 00:10:56.270501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.270289    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="43b6a3837b2d35553569c54c8ef6d46bddf32792f4029ca29ec297bb8fa0e919"
Sep 08 00:10:56.270501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.270242    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbg6sfl"
Sep 08 00:10:56.272263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.272240    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82"
Sep 08 00:10:56.272400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.272271    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cg2k82" event={"ID":"da3a422c-f7b1-4c1f-beea-b2d28ed12f18","Type":"ContainerDied","Data":"8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31"}
Sep 08 00:10:56.272400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.272324    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e031dc7a409581e02bc9ccfda87dcfe1e03a96dbd7fdb68a4e7e008943efa31"
Sep 08 00:10:56.274683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.274663    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t"
Sep 08 00:10:56.274683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.274667    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a05rf9t" event={"ID":"6a4a39e2-0b97-4dd9-9b75-cde620f9140c","Type":"ContainerDied","Data":"860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d"}
Sep 08 00:10:56.274877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.274710    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="860e1114a3a787484f2fb60c75b550f72e6ad8cdee0f77829508086d99175e9d"
Sep 08 00:10:56.276721 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.276697    2580 generic.go:356] "Generic (PLEG): container finished" podID="67121b94-d99a-45a5-8155-5fd925cda833" containerID="f3cb44076b125f3323973096593bb564f9a6658f83cca609cf7a5d3db095aa1e" exitCode=0
Sep 08 00:10:56.276829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:56.276751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb" event={"ID":"67121b94-d99a-45a5-8155-5fd925cda833","Type":"ContainerDied","Data":"f3cb44076b125f3323973096593bb564f9a6658f83cca609cf7a5d3db095aa1e"}
Sep 08 00:10:57.284421 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:57.284383    2580 generic.go:356] "Generic (PLEG): container finished" podID="67121b94-d99a-45a5-8155-5fd925cda833" containerID="0f9a9c40dd39c933eb6df4691fe4f34fa3cc6e506b8426f25969830e8ea901d2" exitCode=0
Sep 08 00:10:57.284916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:57.284493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb" event={"ID":"67121b94-d99a-45a5-8155-5fd925cda833","Type":"ContainerDied","Data":"0f9a9c40dd39c933eb6df4691fe4f34fa3cc6e506b8426f25969830e8ea901d2"}
Sep 08 00:10:58.427772 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.427743    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:58.515805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.515766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle\") pod \"67121b94-d99a-45a5-8155-5fd925cda833\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") "
Sep 08 00:10:58.515805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.515815    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util\") pod \"67121b94-d99a-45a5-8155-5fd925cda833\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") "
Sep 08 00:10:58.516074 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.515865    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlqd2\" (UniqueName: \"kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2\") pod \"67121b94-d99a-45a5-8155-5fd925cda833\" (UID: \"67121b94-d99a-45a5-8155-5fd925cda833\") "
Sep 08 00:10:58.516536 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.516501    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle" (OuterVolumeSpecName: "bundle") pod "67121b94-d99a-45a5-8155-5fd925cda833" (UID: "67121b94-d99a-45a5-8155-5fd925cda833"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:58.518040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.518015    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2" (OuterVolumeSpecName: "kube-api-access-nlqd2") pod "67121b94-d99a-45a5-8155-5fd925cda833" (UID: "67121b94-d99a-45a5-8155-5fd925cda833"). InnerVolumeSpecName "kube-api-access-nlqd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:10:58.521961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.521927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util" (OuterVolumeSpecName: "util") pod "67121b94-d99a-45a5-8155-5fd925cda833" (UID: "67121b94-d99a-45a5-8155-5fd925cda833"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:10:58.616697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.616594    2580 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-bundle\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:58.616697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.616628    2580 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/67121b94-d99a-45a5-8155-5fd925cda833-util\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:58.616697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:58.616637    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlqd2\" (UniqueName: \"kubernetes.io/projected/67121b94-d99a-45a5-8155-5fd925cda833-kube-api-access-nlqd2\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:10:59.296777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:59.296748    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb"
Sep 08 00:10:59.296934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:59.296747    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053lh9nb" event={"ID":"67121b94-d99a-45a5-8155-5fd925cda833","Type":"ContainerDied","Data":"773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227"}
Sep 08 00:10:59.296934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:10:59.296863    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="773f0275e8dd8626b23d280141c99ebb414f0a59dade508a9342de9a034eb227"
Sep 08 00:11:08.470112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470077    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4qmrc"]
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470408    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="extract"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470424    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="extract"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470438    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470444    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470466    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470473    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470481    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="util"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470487    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="util"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470496    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="util"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470501    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="util"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470509    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="extract"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470514    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="extract"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470524    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470529    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="pull"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470536    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="extract"
Sep 08 00:11:08.470533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470541    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470547    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470552    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470558    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="pull"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470563    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="pull"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470571    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="util"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470576    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="util"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470584    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="util"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470589    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="util"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470668    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a4a39e2-0b97-4dd9-9b75-cde620f9140c" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470675    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="67121b94-d99a-45a5-8155-5fd925cda833" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470681    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee596106-8366-4b1b-af81-2cba54497ca0" containerName="extract"
Sep 08 00:11:08.471058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.470688    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3a422c-f7b1-4c1f-beea-b2d28ed12f18" containerName="extract"
Sep 08 00:11:08.473685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.473667    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:08.476208 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.476186    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 00:11:08.476335 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.476185    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j8hk6\""
Sep 08 00:11:08.476744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.476722    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 00:11:08.482546 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.482517    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4qmrc"]
Sep 08 00:11:08.488547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.488517    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvgk2\" (UniqueName: \"kubernetes.io/projected/43baea63-4ef6-4c96-bdd9-bd23f58c93c4-kube-api-access-jvgk2\") pod \"authorino-operator-68d88948d8-4qmrc\" (UID: \"43baea63-4ef6-4c96-bdd9-bd23f58c93c4\") " pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:08.589741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.589701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvgk2\" (UniqueName: \"kubernetes.io/projected/43baea63-4ef6-4c96-bdd9-bd23f58c93c4-kube-api-access-jvgk2\") pod \"authorino-operator-68d88948d8-4qmrc\" (UID: \"43baea63-4ef6-4c96-bdd9-bd23f58c93c4\") " pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:08.607772 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.607736    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvgk2\" (UniqueName: \"kubernetes.io/projected/43baea63-4ef6-4c96-bdd9-bd23f58c93c4-kube-api-access-jvgk2\") pod \"authorino-operator-68d88948d8-4qmrc\" (UID: \"43baea63-4ef6-4c96-bdd9-bd23f58c93c4\") " pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:08.784472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:08.784368    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:09.067729 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:09.067702    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-4qmrc"]
Sep 08 00:11:09.069711 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:09.069681    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43baea63_4ef6_4c96_bdd9_bd23f58c93c4.slice/crio-2b68ec3fe462c1241e53cfd3a0969209876faeee7a1c11f6cea99e13e6c787dc WatchSource:0}: Error finding container 2b68ec3fe462c1241e53cfd3a0969209876faeee7a1c11f6cea99e13e6c787dc: Status 404 returned error can't find the container with id 2b68ec3fe462c1241e53cfd3a0969209876faeee7a1c11f6cea99e13e6c787dc
Sep 08 00:11:09.354795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:09.354696    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc" event={"ID":"43baea63-4ef6-4c96-bdd9-bd23f58c93c4","Type":"ContainerStarted","Data":"2b68ec3fe462c1241e53cfd3a0969209876faeee7a1c11f6cea99e13e6c787dc"}
Sep 08 00:11:10.680439 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.680402    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"]
Sep 08 00:11:10.685394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.685365    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:10.687350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.687327    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-tbdxl\""
Sep 08 00:11:10.694584 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.694556    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"]
Sep 08 00:11:10.707181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.707141    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49mnk\" (UniqueName: \"kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk\") pod \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" (UID: \"bf154af7-8ab0-491f-84c1-f8bbdcf8509d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:10.808626 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.808584    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49mnk\" (UniqueName: \"kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk\") pod \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" (UID: \"bf154af7-8ab0-491f-84c1-f8bbdcf8509d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:10.816872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.816842    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49mnk\" (UniqueName: \"kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk\") pod \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" (UID: \"bf154af7-8ab0-491f-84c1-f8bbdcf8509d\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:10.998589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:10.998550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:11.302706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:11.302678    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"]
Sep 08 00:11:11.304970 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:11.304927    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf154af7_8ab0_491f_84c1_f8bbdcf8509d.slice/crio-6583b1816891423cbfb94190f5f5d07fcfed7c6a8ae51ca1958ed1537c67bc6a WatchSource:0}: Error finding container 6583b1816891423cbfb94190f5f5d07fcfed7c6a8ae51ca1958ed1537c67bc6a: Status 404 returned error can't find the container with id 6583b1816891423cbfb94190f5f5d07fcfed7c6a8ae51ca1958ed1537c67bc6a
Sep 08 00:11:11.370812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:11.370762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6" event={"ID":"bf154af7-8ab0-491f-84c1-f8bbdcf8509d","Type":"ContainerStarted","Data":"6583b1816891423cbfb94190f5f5d07fcfed7c6a8ae51ca1958ed1537c67bc6a"}
Sep 08 00:11:12.980598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:12.980555    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"]
Sep 08 00:11:12.984542 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:12.984518    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:12.986583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:12.986558    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 00:11:12.986720 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:12.986597    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4qh5d\""
Sep 08 00:11:12.995038 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:12.995009    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"]
Sep 08 00:11:13.026853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.026801    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q5ldb\" (UniqueName: \"kubernetes.io/projected/b188b2b5-0eab-4662-b7bc-30ea39a3d411-kube-api-access-q5ldb\") pod \"dns-operator-controller-manager-5985564776-wdtm7\" (UID: \"b188b2b5-0eab-4662-b7bc-30ea39a3d411\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:13.127760 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.127658    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q5ldb\" (UniqueName: \"kubernetes.io/projected/b188b2b5-0eab-4662-b7bc-30ea39a3d411-kube-api-access-q5ldb\") pod \"dns-operator-controller-manager-5985564776-wdtm7\" (UID: \"b188b2b5-0eab-4662-b7bc-30ea39a3d411\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:13.138436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.138408    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q5ldb\" (UniqueName: \"kubernetes.io/projected/b188b2b5-0eab-4662-b7bc-30ea39a3d411-kube-api-access-q5ldb\") pod \"dns-operator-controller-manager-5985564776-wdtm7\" (UID: \"b188b2b5-0eab-4662-b7bc-30ea39a3d411\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:13.299310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.299271    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:13.386668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.386563    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc" event={"ID":"43baea63-4ef6-4c96-bdd9-bd23f58c93c4","Type":"ContainerStarted","Data":"1751e96ebb96c8cfa9f4cd0ecdbfaa632df172c2f025d9779b50830941e53841"}
Sep 08 00:11:13.386668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.386662    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:13.407794 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.407740    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc" podStartSLOduration=1.601846066 podStartE2EDuration="5.407721311s" totalImagesPullingTime="3.805875245s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:13.406700421 +0000 UTC m=+516.157397289" watchObservedRunningTime="2026-09-08 00:11:13.407721311 +0000 UTC m=+516.158418155"
Sep 08 00:11:13.577031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:13.577003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"]
Sep 08 00:11:13.579261 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:13.579228    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb188b2b5_0eab_4662_b7bc_30ea39a3d411.slice/crio-5c223ea8e28217fe43fd051609a43e0f8992884f41f3251366318b1df42beb23 WatchSource:0}: Error finding container 5c223ea8e28217fe43fd051609a43e0f8992884f41f3251366318b1df42beb23: Status 404 returned error can't find the container with id 5c223ea8e28217fe43fd051609a43e0f8992884f41f3251366318b1df42beb23
Sep 08 00:11:14.394297 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:14.394207    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6" event={"ID":"bf154af7-8ab0-491f-84c1-f8bbdcf8509d","Type":"ContainerStarted","Data":"d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa"}
Sep 08 00:11:14.394724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:14.394321    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:14.395752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:14.395733    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7" event={"ID":"b188b2b5-0eab-4662-b7bc-30ea39a3d411","Type":"ContainerStarted","Data":"5c223ea8e28217fe43fd051609a43e0f8992884f41f3251366318b1df42beb23"}
Sep 08 00:11:14.417996 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:14.417934    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6" podStartSLOduration=1.642974309 podStartE2EDuration="4.417917696s" totalImagesPullingTime="2.774943387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:14.417285407 +0000 UTC m=+517.167982274" watchObservedRunningTime="2026-09-08 00:11:14.417917696 +0000 UTC m=+517.168614541"
Sep 08 00:11:15.404181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:15.404141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7" event={"ID":"b188b2b5-0eab-4662-b7bc-30ea39a3d411","Type":"ContainerStarted","Data":"ef46d6efccc27d8cd9a3f0967cb6f1651a2e5ea8503f67c70ef78fdc1d15aafe"}
Sep 08 00:11:15.404705 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:15.404230    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:15.421426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:15.421354    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7" podStartSLOduration=1.735895251 podStartE2EDuration="3.421334818s" totalImagesPullingTime="1.685439567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:15.419841663 +0000 UTC m=+518.170538506" watchObservedRunningTime="2026-09-08 00:11:15.421334818 +0000 UTC m=+518.172031661"
Sep 08 00:11:17.106980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.106943    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"]
Sep 08 00:11:17.110626 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.110607    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.112859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.112837    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lf292\""
Sep 08 00:11:17.129383 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.129346    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"]
Sep 08 00:11:17.166101 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.166060    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5dwz\" (UniqueName: \"kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.166274 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.166126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.266726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.266635    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5dwz\" (UniqueName: \"kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.266726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.266697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.267095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.267077    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.277349 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.277316    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5dwz\" (UniqueName: \"kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz\") pod \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.423279 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.423242    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:17.707653 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:17.707619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"]
Sep 08 00:11:17.708847 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:17.708816    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b98600a_074e_4527_82aa_2702c1318ecb.slice/crio-b92f6dee441fbbffc9687269e3139e1df51b4b7cfc82ec8b3ff4a0cc8d1c0f0a WatchSource:0}: Error finding container b92f6dee441fbbffc9687269e3139e1df51b4b7cfc82ec8b3ff4a0cc8d1c0f0a: Status 404 returned error can't find the container with id b92f6dee441fbbffc9687269e3139e1df51b4b7cfc82ec8b3ff4a0cc8d1c0f0a
Sep 08 00:11:18.421973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:18.421935    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27" event={"ID":"1b98600a-074e-4527-82aa-2702c1318ecb","Type":"ContainerStarted","Data":"b92f6dee441fbbffc9687269e3139e1df51b4b7cfc82ec8b3ff4a0cc8d1c0f0a"}
Sep 08 00:11:22.450937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:22.450838    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27" event={"ID":"1b98600a-074e-4527-82aa-2702c1318ecb","Type":"ContainerStarted","Data":"5d698a87b1b3e2303f445238a46c703a3143191d3c7f43b9daee85cf07a7521b"}
Sep 08 00:11:22.451353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:22.450943    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:22.469311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:22.469256    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27" podStartSLOduration=1.134838597 podStartE2EDuration="5.469238237s" totalImagesPullingTime="4.33439964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:22.467795795 +0000 UTC m=+525.218492639" watchObservedRunningTime="2026-09-08 00:11:22.469238237 +0000 UTC m=+525.219935080"
Sep 08 00:11:24.398136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.398101    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-4qmrc"
Sep 08 00:11:24.831717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.831671    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"]
Sep 08 00:11:24.837426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.837395    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:24.839638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.839612    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-xbkxf\""
Sep 08 00:11:24.839769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.839660    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 08 00:11:24.839916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.839902    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 08 00:11:24.846182 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.846074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"]
Sep 08 00:11:24.935756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.935718    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9vbb\" (UniqueName: \"kubernetes.io/projected/386d7c9e-71a1-4b92-8ba9-2469c8c31211-kube-api-access-j9vbb\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:24.935945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.935778    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/386d7c9e-71a1-4b92-8ba9-2469c8c31211-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:24.935945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:24.935814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/386d7c9e-71a1-4b92-8ba9-2469c8c31211-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.036904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.036865    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9vbb\" (UniqueName: \"kubernetes.io/projected/386d7c9e-71a1-4b92-8ba9-2469c8c31211-kube-api-access-j9vbb\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.037091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.036930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/386d7c9e-71a1-4b92-8ba9-2469c8c31211-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.037091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.036969    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/386d7c9e-71a1-4b92-8ba9-2469c8c31211-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.037662 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.037641    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/386d7c9e-71a1-4b92-8ba9-2469c8c31211-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.039522 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.039501    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/386d7c9e-71a1-4b92-8ba9-2469c8c31211-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.044052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.044025    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9vbb\" (UniqueName: \"kubernetes.io/projected/386d7c9e-71a1-4b92-8ba9-2469c8c31211-kube-api-access-j9vbb\") pod \"kuadrant-console-plugin-598f86468b-psnxp\" (UID: \"386d7c9e-71a1-4b92-8ba9-2469c8c31211\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.147679 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.147572    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"
Sep 08 00:11:25.406392 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.406311    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:25.420683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.420644    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp"]
Sep 08 00:11:25.422098 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:25.422074    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod386d7c9e_71a1_4b92_8ba9_2469c8c31211.slice/crio-07b9355dc8fde85bb4c0643428fa6b5df4a9262dd2739885d25841ce445739de WatchSource:0}: Error finding container 07b9355dc8fde85bb4c0643428fa6b5df4a9262dd2739885d25841ce445739de: Status 404 returned error can't find the container with id 07b9355dc8fde85bb4c0643428fa6b5df4a9262dd2739885d25841ce445739de
Sep 08 00:11:25.468711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:25.468676    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp" event={"ID":"386d7c9e-71a1-4b92-8ba9-2469c8c31211","Type":"ContainerStarted","Data":"07b9355dc8fde85bb4c0643428fa6b5df4a9262dd2739885d25841ce445739de"}
Sep 08 00:11:26.412240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:26.412211    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-wdtm7"
Sep 08 00:11:33.458833 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:33.458742    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.367311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.367271    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"]
Sep 08 00:11:35.367784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.367475    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" containerName="manager" containerID="cri-o://5d698a87b1b3e2303f445238a46c703a3143191d3c7f43b9daee85cf07a7521b" gracePeriod=2
Sep 08 00:11:35.373347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.373317    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"]
Sep 08 00:11:35.389283 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.389257    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:35.389665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.389648    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" containerName="manager"
Sep 08 00:11:35.389719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.389669    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" containerName="manager"
Sep 08 00:11:35.389756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.389745    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" containerName="manager"
Sep 08 00:11:35.400865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.400825    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.402831 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.402797    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.408870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.408841    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:35.417845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.417816    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"]
Sep 08 00:11:35.418337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.418080    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" containerName="manager" containerID="cri-o://d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa" gracePeriod=2
Sep 08 00:11:35.425257 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.425232    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"]
Sep 08 00:11:35.436768 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.436736    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:35.439593 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.439558    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.443514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.443483    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"]
Sep 08 00:11:35.443871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.443855    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" containerName="manager"
Sep 08 00:11:35.443952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.443875    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" containerName="manager"
Sep 08 00:11:35.444006 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.443992    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" containerName="manager"
Sep 08 00:11:35.447090 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.447073    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:35.458157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.458132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"]
Sep 08 00:11:35.473484 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.473428    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:35.474941 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.474895    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.526617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.526589    2580 generic.go:356] "Generic (PLEG): container finished" podID="1b98600a-074e-4527-82aa-2702c1318ecb" containerID="5d698a87b1b3e2303f445238a46c703a3143191d3c7f43b9daee85cf07a7521b" exitCode=0
Sep 08 00:11:35.528993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.528962    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9jc8\" (UniqueName: \"kubernetes.io/projected/f01b329d-3d8e-460c-b169-1153790ffee8-kube-api-access-k9jc8\") pod \"limitador-operator-controller-manager-6c549b6d85-h2ggs\" (UID: \"f01b329d-3d8e-460c-b169-1153790ffee8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:35.529117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.529027    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nj584\" (UniqueName: \"kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.529117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.529078    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.630049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.630019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.630147 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.630129    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9jc8\" (UniqueName: \"kubernetes.io/projected/f01b329d-3d8e-460c-b169-1153790ffee8-kube-api-access-k9jc8\") pod \"limitador-operator-controller-manager-6c549b6d85-h2ggs\" (UID: \"f01b329d-3d8e-460c-b169-1153790ffee8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:35.630197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.630184    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nj584\" (UniqueName: \"kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.630427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.630399    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.638356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.638331    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nj584\" (UniqueName: \"kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584\") pod \"kuadrant-operator-controller-manager-58fc56757c-jhf7k\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.638494 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.638332    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9jc8\" (UniqueName: \"kubernetes.io/projected/f01b329d-3d8e-460c-b169-1153790ffee8-kube-api-access-k9jc8\") pod \"limitador-operator-controller-manager-6c549b6d85-h2ggs\" (UID: \"f01b329d-3d8e-460c-b169-1153790ffee8\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:35.662341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.662314    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.664299 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.664266    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:35.665614 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.665586    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.679215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.679192    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:35.680931 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.680906    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-pnzb6\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:35.682272 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:35.682251    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-ncp27\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:35.731175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.731140    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p5dwz\" (UniqueName: \"kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz\") pod \"1b98600a-074e-4527-82aa-2702c1318ecb\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") "
Sep 08 00:11:35.731345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.731235    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume\") pod \"1b98600a-074e-4527-82aa-2702c1318ecb\" (UID: \"1b98600a-074e-4527-82aa-2702c1318ecb\") "
Sep 08 00:11:35.731679 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.731656    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1b98600a-074e-4527-82aa-2702c1318ecb" (UID: "1b98600a-074e-4527-82aa-2702c1318ecb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:11:35.733382 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.733359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz" (OuterVolumeSpecName: "kube-api-access-p5dwz") pod "1b98600a-074e-4527-82aa-2702c1318ecb" (UID: "1b98600a-074e-4527-82aa-2702c1318ecb"). InnerVolumeSpecName "kube-api-access-p5dwz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:11:35.773707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.773672    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b98600a-074e-4527-82aa-2702c1318ecb" path="/var/lib/kubelet/pods/1b98600a-074e-4527-82aa-2702c1318ecb/volumes"
Sep 08 00:11:35.787151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.787121    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:35.793248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.793226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:35.832702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.832629    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49mnk\" (UniqueName: \"kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk\") pod \"bf154af7-8ab0-491f-84c1-f8bbdcf8509d\" (UID: \"bf154af7-8ab0-491f-84c1-f8bbdcf8509d\") "
Sep 08 00:11:35.832991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.832975    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1b98600a-074e-4527-82aa-2702c1318ecb-extensions-socket-volume\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:11:35.833065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.832999    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p5dwz\" (UniqueName: \"kubernetes.io/projected/1b98600a-074e-4527-82aa-2702c1318ecb-kube-api-access-p5dwz\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:11:35.834789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.834755    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk" (OuterVolumeSpecName: "kube-api-access-49mnk") pod "bf154af7-8ab0-491f-84c1-f8bbdcf8509d" (UID: "bf154af7-8ab0-491f-84c1-f8bbdcf8509d"). InnerVolumeSpecName "kube-api-access-49mnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:11:35.933746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:35.933647    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49mnk\" (UniqueName: \"kubernetes.io/projected/bf154af7-8ab0-491f-84c1-f8bbdcf8509d-kube-api-access-49mnk\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:11:36.071079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.071043    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:36.074591 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:36.074521    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd19abb7d_4920_4b47_b9d9_117067bfc6d6.slice/crio-eb169a9d7c480aad38569f02f6039f67f85fa839f45de49c291087dd753d5608 WatchSource:0}: Error finding container eb169a9d7c480aad38569f02f6039f67f85fa839f45de49c291087dd753d5608: Status 404 returned error can't find the container with id eb169a9d7c480aad38569f02f6039f67f85fa839f45de49c291087dd753d5608
Sep 08 00:11:36.078392 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.078364    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"]
Sep 08 00:11:36.080354 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:36.080332    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf01b329d_3d8e_460c_b169_1153790ffee8.slice/crio-e6cf3ed10b447b9132032b9286fc923054e24d8e148142d9a7937ebc6f4236a7 WatchSource:0}: Error finding container e6cf3ed10b447b9132032b9286fc923054e24d8e148142d9a7937ebc6f4236a7: Status 404 returned error can't find the container with id e6cf3ed10b447b9132032b9286fc923054e24d8e148142d9a7937ebc6f4236a7
Sep 08 00:11:36.534920 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.534878    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" event={"ID":"d19abb7d-4920-4b47-b9d9-117067bfc6d6","Type":"ContainerStarted","Data":"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"}
Sep 08 00:11:36.535403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.534943    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" event={"ID":"d19abb7d-4920-4b47-b9d9-117067bfc6d6","Type":"ContainerStarted","Data":"eb169a9d7c480aad38569f02f6039f67f85fa839f45de49c291087dd753d5608"}
Sep 08 00:11:36.535403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.535045    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:36.536372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.536348    2580 generic.go:356] "Generic (PLEG): container finished" podID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" containerID="d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa" exitCode=0
Sep 08 00:11:36.536490 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.536385    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-pnzb6"
Sep 08 00:11:36.536490 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.536441    2580 scope.go:117] "RemoveContainer" containerID="d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa"
Sep 08 00:11:36.538559 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.538535    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs" event={"ID":"f01b329d-3d8e-460c-b169-1153790ffee8","Type":"ContainerStarted","Data":"8831dbc3fde8b03c84a8737566bb4a102e8058b92b746b7605b4377d91fdd1e7"}
Sep 08 00:11:36.538674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.538585    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs" event={"ID":"f01b329d-3d8e-460c-b169-1153790ffee8","Type":"ContainerStarted","Data":"e6cf3ed10b447b9132032b9286fc923054e24d8e148142d9a7937ebc6f4236a7"}
Sep 08 00:11:36.538674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.538615    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:36.540137 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.540121    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-ncp27"
Sep 08 00:11:36.549209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.549191    2580 scope.go:117] "RemoveContainer" containerID="d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa"
Sep 08 00:11:36.549553 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:36.549532    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa\": container with ID starting with d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa not found: ID does not exist" containerID="d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa"
Sep 08 00:11:36.549634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.549559    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa"} err="failed to get container status \"d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa\": rpc error: code = NotFound desc = could not find container \"d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa\": container with ID starting with d5a42c0739c02868e59ccbbd7606ee85e19688c9f2e848005b2f34bda275f0fa not found: ID does not exist"
Sep 08 00:11:36.549634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.549577    2580 scope.go:117] "RemoveContainer" containerID="5d698a87b1b3e2303f445238a46c703a3143191d3c7f43b9daee85cf07a7521b"
Sep 08 00:11:36.554091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.554051    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" podStartSLOduration=1.55403698 podStartE2EDuration="1.55403698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:36.551727221 +0000 UTC m=+539.302424072" watchObservedRunningTime="2026-09-08 00:11:36.55403698 +0000 UTC m=+539.304733819"
Sep 08 00:11:36.568508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:36.568440    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs" podStartSLOduration=1.568424576 podStartE2EDuration="1.568424576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:36.566259168 +0000 UTC m=+539.316956011" watchObservedRunningTime="2026-09-08 00:11:36.568424576 +0000 UTC m=+539.319121421"
Sep 08 00:11:37.774855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:37.774815    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf154af7-8ab0-491f-84c1-f8bbdcf8509d" path="/var/lib/kubelet/pods/bf154af7-8ab0-491f-84c1-f8bbdcf8509d/volumes"
Sep 08 00:11:43.589321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:43.589286    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp" event={"ID":"386d7c9e-71a1-4b92-8ba9-2469c8c31211","Type":"ContainerStarted","Data":"a45aa43ad6ad9d6599b772ed92c16bcd732f10e7c84c02340254715b29d22d46"}
Sep 08 00:11:43.605606 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:43.605552    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-psnxp" podStartSLOduration=2.302806965 podStartE2EDuration="19.605535384s" totalImagesPullingTime="17.302728419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:43.603247442 +0000 UTC m=+546.353944285" watchObservedRunningTime="2026-09-08 00:11:43.605535384 +0000 UTC m=+546.356232228"
Sep 08 00:11:47.549947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:47.549912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-h2ggs"
Sep 08 00:11:47.550333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:47.549992    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:52.310197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.310158    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:52.310805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.310434    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" podUID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" containerName="manager" containerID="cri-o://142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79" gracePeriod=10
Sep 08 00:11:52.534234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.534188    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:11:52.540428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.540390    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.547357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.547327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:11:52.579985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.579957    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:52.645029 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.644989    2580 generic.go:356] "Generic (PLEG): container finished" podID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" containerID="142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79" exitCode=0
Sep 08 00:11:52.645188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.645041    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"
Sep 08 00:11:52.645188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.645059    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" event={"ID":"d19abb7d-4920-4b47-b9d9-117067bfc6d6","Type":"ContainerDied","Data":"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"}
Sep 08 00:11:52.645188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.645134    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k" event={"ID":"d19abb7d-4920-4b47-b9d9-117067bfc6d6","Type":"ContainerDied","Data":"eb169a9d7c480aad38569f02f6039f67f85fa839f45de49c291087dd753d5608"}
Sep 08 00:11:52.645188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.645170    2580 scope.go:117] "RemoveContainer" containerID="142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"
Sep 08 00:11:52.654612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.654590    2580 scope.go:117] "RemoveContainer" containerID="142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"
Sep 08 00:11:52.654943 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:11:52.654921    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79\": container with ID starting with 142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79 not found: ID does not exist" containerID="142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"
Sep 08 00:11:52.655017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.654952    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79"} err="failed to get container status \"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79\": rpc error: code = NotFound desc = could not find container \"142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79\": container with ID starting with 142dafb9a15216cc5c95005f5d41216f388e09b837aa139586623367cdf4ed79 not found: ID does not exist"
Sep 08 00:11:52.684343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.684306    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume\") pod \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") "
Sep 08 00:11:52.684343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.684356    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nj584\" (UniqueName: \"kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584\") pod \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\" (UID: \"d19abb7d-4920-4b47-b9d9-117067bfc6d6\") "
Sep 08 00:11:52.684658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.684500    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.684658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.684550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vxzz\" (UniqueName: \"kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.684773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.684728    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d19abb7d-4920-4b47-b9d9-117067bfc6d6" (UID: "d19abb7d-4920-4b47-b9d9-117067bfc6d6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:11:52.686550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.686521    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584" (OuterVolumeSpecName: "kube-api-access-nj584") pod "d19abb7d-4920-4b47-b9d9-117067bfc6d6" (UID: "d19abb7d-4920-4b47-b9d9-117067bfc6d6"). InnerVolumeSpecName "kube-api-access-nj584". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:11:52.785879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.785835    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.786064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.785899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vxzz\" (UniqueName: \"kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.786064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.785990    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d19abb7d-4920-4b47-b9d9-117067bfc6d6-extensions-socket-volume\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:11:52.786199 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.786125    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nj584\" (UniqueName: \"kubernetes.io/projected/d19abb7d-4920-4b47-b9d9-117067bfc6d6-kube-api-access-nj584\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:11:52.786333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.786310    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.797945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.797914    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vxzz\" (UniqueName: \"kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-6n6pp\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.852700 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.852606    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:52.968240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.968200    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:52.971585 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:52.971553    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-jhf7k"]
Sep 08 00:11:53.135110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.135082    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:11:53.136377 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:11:53.136351    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0436f04_5a99_4547_9d9c_8b83f86e3676.slice/crio-1e7cfea02f0ff01c82bdd9e139faae657809e82ecb0a2e13ef4f316b18730b4e WatchSource:0}: Error finding container 1e7cfea02f0ff01c82bdd9e139faae657809e82ecb0a2e13ef4f316b18730b4e: Status 404 returned error can't find the container with id 1e7cfea02f0ff01c82bdd9e139faae657809e82ecb0a2e13ef4f316b18730b4e
Sep 08 00:11:53.654196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.654158    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" event={"ID":"b0436f04-5a99-4547-9d9c-8b83f86e3676","Type":"ContainerStarted","Data":"05e3b1ad9c77857dcbab31f0152ac176e2d05812a1fb57c65d883d29ad0a7aad"}
Sep 08 00:11:53.654726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.654218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" event={"ID":"b0436f04-5a99-4547-9d9c-8b83f86e3676","Type":"ContainerStarted","Data":"1e7cfea02f0ff01c82bdd9e139faae657809e82ecb0a2e13ef4f316b18730b4e"}
Sep 08 00:11:53.654726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.654258    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:11:53.677538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.677480    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" podStartSLOduration=1.67744494 podStartE2EDuration="1.67744494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:11:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:11:53.675883194 +0000 UTC m=+556.426580041" watchObservedRunningTime="2026-09-08 00:11:53.67744494 +0000 UTC m=+556.428141788"
Sep 08 00:11:53.774182 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:11:53.774143    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" path="/var/lib/kubelet/pods/d19abb7d-4920-4b47-b9d9-117067bfc6d6/volumes"
Sep 08 00:12:04.663398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:04.663365    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:12:08.572401 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.572359    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"]
Sep 08 00:12:08.572982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.572878    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" containerName="manager"
Sep 08 00:12:08.572982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.572899    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" containerName="manager"
Sep 08 00:12:08.573136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.572999    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d19abb7d-4920-4b47-b9d9-117067bfc6d6" containerName="manager"
Sep 08 00:12:08.576490 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.576442    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.578620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.578593    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ww9jf\""
Sep 08 00:12:08.588119 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.588088    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"]
Sep 08 00:12:08.623504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623446    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623504 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhvgs\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-kube-api-access-vhvgs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623604    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623734    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623779    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.623934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.623821    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccb2526e-f0d0-43b0-a432-b3060a577737-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724311    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724351    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724371    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhvgs\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-kube-api-access-vhvgs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724400    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724415    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724437    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.724665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724496    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.724992    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.725071    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccb2526e-f0d0-43b0-a432-b3060a577737-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.725199    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.725241    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.725410    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.725676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.725651    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.726079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.726054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccb2526e-f0d0-43b0-a432-b3060a577737-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.727882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.727855    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.728832 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.728809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.734959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.734917    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.735516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.735493    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhvgs\" (UniqueName: \"kubernetes.io/projected/ccb2526e-f0d0-43b0-a432-b3060a577737-kube-api-access-vhvgs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-w4kz7\" (UID: \"ccb2526e-f0d0-43b0-a432-b3060a577737\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:08.891198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:08.891089    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:09.167774 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.167745    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"]
Sep 08 00:12:09.168821 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:12:09.168799    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccb2526e_f0d0_43b0_a432_b3060a577737.slice/crio-013d084c3db34150549a419bdb7029dfe43388d49ba927a6a21765df493c81be WatchSource:0}: Error finding container 013d084c3db34150549a419bdb7029dfe43388d49ba927a6a21765df493c81be: Status 404 returned error can't find the container with id 013d084c3db34150549a419bdb7029dfe43388d49ba927a6a21765df493c81be
Sep 08 00:12:09.171158 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.171116    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:12:09.171255 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.171184    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:12:09.171255 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.171217    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:12:09.745508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.745470    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" event={"ID":"ccb2526e-f0d0-43b0-a432-b3060a577737","Type":"ContainerStarted","Data":"2878ecc6f77c4e60b24831069668875fad82b59f32104d682b420c0cedc40bea"}
Sep 08 00:12:09.746013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.745520    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" event={"ID":"ccb2526e-f0d0-43b0-a432-b3060a577737","Type":"ContainerStarted","Data":"013d084c3db34150549a419bdb7029dfe43388d49ba927a6a21765df493c81be"}
Sep 08 00:12:09.766479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.766413    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podStartSLOduration=1.766394527 podStartE2EDuration="1.766394527s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:09.763063731 +0000 UTC m=+572.513760577" watchObservedRunningTime="2026-09-08 00:12:09.766394527 +0000 UTC m=+572.517091371"
Sep 08 00:12:09.891724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:09.891683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:10.896403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:10.896372    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:11.757064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:11.757029    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:11.758020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:11.757997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:12:21.659006 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.658970    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:12:21.683982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.683944    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:12:21.683982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.683986    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:12:21.684188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.684074    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.686515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.686481    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 00:12:21.741965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.741927    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99zzk\" (UniqueName: \"kubernetes.io/projected/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-kube-api-access-99zzk\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.742150 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.741983    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-config-file\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.843245 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.843206    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99zzk\" (UniqueName: \"kubernetes.io/projected/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-kube-api-access-99zzk\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.843444 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.843270    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-config-file\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.844106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.844080    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-config-file\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.852653 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.852625    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99zzk\" (UniqueName: \"kubernetes.io/projected/1cb4f1e8-65d7-4ece-8d31-137dc0eee8da-kube-api-access-99zzk\") pod \"limitador-limitador-85d9db4d5d-5bzrh\" (UID: \"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:21.998115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:21.998070    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:22.277326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:22.277291    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:12:22.278577 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:12:22.278546    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb4f1e8_65d7_4ece_8d31_137dc0eee8da.slice/crio-1a0291a541776128a2a806424f13f3e34bed37a3f46f85d7b0b4a7b79d4f4c12 WatchSource:0}: Error finding container 1a0291a541776128a2a806424f13f3e34bed37a3f46f85d7b0b4a7b79d4f4c12: Status 404 returned error can't find the container with id 1a0291a541776128a2a806424f13f3e34bed37a3f46f85d7b0b4a7b79d4f4c12
Sep 08 00:12:22.821502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:22.821463    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh" event={"ID":"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da","Type":"ContainerStarted","Data":"1a0291a541776128a2a806424f13f3e34bed37a3f46f85d7b0b4a7b79d4f4c12"}
Sep 08 00:12:23.828957 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:23.828919    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh" event={"ID":"1cb4f1e8-65d7-4ece-8d31-137dc0eee8da","Type":"ContainerStarted","Data":"8611c314c9ecbe7428c5732222ce906d3218955f53258ccaca592e0ce5db1759"}
Sep 08 00:12:23.829357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:23.829009    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:23.845351 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:23.845242    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh" podStartSLOduration=1.5414006759999999 podStartE2EDuration="2.845226981s" totalImagesPullingTime="1.303826305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:12:23.843167224 +0000 UTC m=+586.593864069" watchObservedRunningTime="2026-09-08 00:12:23.845226981 +0000 UTC m=+586.595923864"
Sep 08 00:12:34.837150 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:34.837112    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"
Sep 08 00:12:37.722121 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:37.722088    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:12:37.725227 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:12:37.725203    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:13:36.083391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:36.083349    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:13:46.302822 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.302774    2580 generic.go:356] "Generic (PLEG): container finished" podID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerID="2878ecc6f77c4e60b24831069668875fad82b59f32104d682b420c0cedc40bea" exitCode=0
Sep 08 00:13:46.303260 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.302846    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" event={"ID":"ccb2526e-f0d0-43b0-a432-b3060a577737","Type":"ContainerDied","Data":"2878ecc6f77c4e60b24831069668875fad82b59f32104d682b420c0cedc40bea"}
Sep 08 00:13:46.303312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.303262    2580 scope.go:117] "RemoveContainer" containerID="2878ecc6f77c4e60b24831069668875fad82b59f32104d682b420c0cedc40bea"
Sep 08 00:13:46.304415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.304383    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:13:46.304496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.304470    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:13:46.304547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:46.304506    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:13:47.310160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:47.310126    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" event={"ID":"ccb2526e-f0d0-43b0-a432-b3060a577737","Type":"ContainerStarted","Data":"d1a3ae5a6e5f4a0fef63169d7d2ccdc6c6166a23b9a053e63ace4e1e72bf9a26"}
Sep 08 00:13:47.891715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:47.891672    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:13:47.892041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:47.891939    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w4kz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 08 00:13:47.892041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:47.892003    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podUID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 08 00:13:48.892242 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:48.892201    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w4kz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 08 00:13:48.892683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:48.892263    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podUID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 08 00:13:49.891550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:49.891507    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w4kz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 08 00:13:49.891746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:49.891571    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podUID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 08 00:13:50.891533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:50.891499    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w4kz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 08 00:13:50.891919 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:50.891565    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podUID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 08 00:13:51.892357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:51.892324    2580 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-w4kz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 08 00:13:51.892776 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:51.892380    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7" podUID="ccb2526e-f0d0-43b0-a432-b3060a577737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 08 00:13:52.896373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:52.896336    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:13:52.896802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:52.896661    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:13:52.897394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:13:52.897371    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-w4kz7"
Sep 08 00:14:06.080675 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:06.080628    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:14:20.368203 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.368166    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"]
Sep 08 00:14:20.371804 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.371776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.374079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.374051    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 00:14:20.374304 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.374128    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 00:14:20.375359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.375106    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2xmvm\""
Sep 08 00:14:20.375359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.375115    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 00:14:20.381198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.381172    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"]
Sep 08 00:14:20.440253 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.440486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440276    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.440486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.440486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440395    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.440486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440413    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cms5p\" (UniqueName: \"kubernetes.io/projected/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-kube-api-access-cms5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.440663 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.440559    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542022    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542079    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542146    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cms5p\" (UniqueName: \"kubernetes.io/projected/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-kube-api-access-cms5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542217    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542626 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542589    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542642    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.542868 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.542840    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.544801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.544772    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.545092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.545065    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.550269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.550232    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cms5p\" (UniqueName: \"kubernetes.io/projected/7e4f2456-5f8e-4698-be83-b6deecbbf4b6-kube-api-access-cms5p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qbd4t\" (UID: \"7e4f2456-5f8e-4698-be83-b6deecbbf4b6\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.686120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.686011    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:20.967903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.967870    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"]
Sep 08 00:14:20.970497 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:14:20.970431    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4f2456_5f8e_4698_be83_b6deecbbf4b6.slice/crio-311c04fb288089e793c719bdb2c6561df661e8db3da62c10b3f0ad876cb1c390 WatchSource:0}: Error finding container 311c04fb288089e793c719bdb2c6561df661e8db3da62c10b3f0ad876cb1c390: Status 404 returned error can't find the container with id 311c04fb288089e793c719bdb2c6561df661e8db3da62c10b3f0ad876cb1c390
Sep 08 00:14:20.972042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:20.972022    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:14:21.069444 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:21.069403    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:14:21.539087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:21.538989    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t" event={"ID":"7e4f2456-5f8e-4698-be83-b6deecbbf4b6","Type":"ContainerStarted","Data":"311c04fb288089e793c719bdb2c6561df661e8db3da62c10b3f0ad876cb1c390"}
Sep 08 00:14:22.548500 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:22.548436    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t" event={"ID":"7e4f2456-5f8e-4698-be83-b6deecbbf4b6","Type":"ContainerStarted","Data":"6dde9b340692ccaa350691465ee65f1c2e35367dab61f7d4b563aacca8c3c9de"}
Sep 08 00:14:22.565557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:22.565481    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t" podStartSLOduration=1.515910898 podStartE2EDuration="2.565463222s" totalImagesPullingTime="1.049552324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:14:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:14:22.562947802 +0000 UTC m=+705.313644649" watchObservedRunningTime="2026-09-08 00:14:22.565463222 +0000 UTC m=+705.316160057"
Sep 08 00:14:30.686242 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:30.686146    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:30.686242 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:30.686215    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:30.698927 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:30.698897    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:31.612783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:31.612749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qbd4t"
Sep 08 00:14:34.681465 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:14:34.681420    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:15:00.134814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.134775    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"]
Sep 08 00:15:00.140204 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.140174    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"
Sep 08 00:15:00.142444 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.142420    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:15:00.143302 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.143280    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"]
Sep 08 00:15:00.152748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.152726    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"
Sep 08 00:15:00.426133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.426107    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"]
Sep 08 00:15:00.428282 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:15:00.428251    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40e12df9_2472_492a_9712_69918a9446c8.slice/crio-b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c WatchSource:0}: Error finding container b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c: Status 404 returned error can't find the container with id b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c
Sep 08 00:15:00.770043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:00.770010    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n" event={"ID":"40e12df9-2472-492a-9712-69918a9446c8","Type":"ContainerStarted","Data":"b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c"}
Sep 08 00:15:03.789679 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:03.789641    2580 generic.go:356] "Generic (PLEG): container finished" podID="40e12df9-2472-492a-9712-69918a9446c8" containerID="8692b352676db147bf0ba2d67d2af6a3f948582023d352284094e2a550e109ce" exitCode=0
Sep 08 00:15:03.790110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:03.789719    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n" event={"ID":"40e12df9-2472-492a-9712-69918a9446c8","Type":"ContainerDied","Data":"8692b352676db147bf0ba2d67d2af6a3f948582023d352284094e2a550e109ce"}
Sep 08 00:15:04.932200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:04.932173    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"
Sep 08 00:15:05.802041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:05.802014    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n"
Sep 08 00:15:05.802188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:05.802045    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29813775-c224n" event={"ID":"40e12df9-2472-492a-9712-69918a9446c8","Type":"ContainerDied","Data":"b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c"}
Sep 08 00:15:05.802188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:05.802091    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b12e955394ed034976904e6c581b3dcde4ccc50992674993fd0eec867b002c5c"
Sep 08 00:15:14.974994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:14.974953    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:15:22.973844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:22.973807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:15:46.269241 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:46.269192    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:15:57.274018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:15:57.273978    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:17:31.996339 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:31.996251    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:17:31.996861 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:31.996829    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40e12df9-2472-492a-9712-69918a9446c8" containerName="cleanup"
Sep 08 00:17:31.996861 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:31.996852    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="40e12df9-2472-492a-9712-69918a9446c8" containerName="cleanup"
Sep 08 00:17:31.996991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:31.996978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="40e12df9-2472-492a-9712-69918a9446c8" containerName="cleanup"
Sep 08 00:17:32.000572 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.000547    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.002598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.002568    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-4374d7-openshift-default-dockercfg-c94b7\""
Sep 08 00:17:32.012076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.012049    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:17:32.139269 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4z9k\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139399    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139486    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139511 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139510    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139527    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.139802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.139550    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240239 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4z9k\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240306    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240326    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240364    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240431    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240864 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240791    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240927 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240867    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.240927 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240893    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.241033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.240981    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.241314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.241294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.242970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.242945    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.243206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.243184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.247370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.247309    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.247501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.247464    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4z9k\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k\") pod \"e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") " pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.334711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.334677    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:32.619516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.619482    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:17:32.620622 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:32.620597    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfc1bd86_f9c2_4678_a3a0_8c60d4a6cfa7.slice/crio-4aac1211992d98087a689539432cb6341fd1348de0cb740a1c5d6a219f34237a WatchSource:0}: Error finding container 4aac1211992d98087a689539432cb6341fd1348de0cb740a1c5d6a219f34237a: Status 404 returned error can't find the container with id 4aac1211992d98087a689539432cb6341fd1348de0cb740a1c5d6a219f34237a
Sep 08 00:17:32.623047 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.623006    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:32.623143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.623083    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:32.623143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.623121    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:32.675680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:32.675657    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerStarted","Data":"4aac1211992d98087a689539432cb6341fd1348de0cb740a1c5d6a219f34237a"}
Sep 08 00:17:33.645330 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.645287    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:33.649042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.649017    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:33.651216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.651196    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-79v5x\""
Sep 08 00:17:33.654361 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.654340    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:33.683185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.683156    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerStarted","Data":"287fe7abff594d9dc287c8eff53d26408c6280892fdf99c1b5db2e80b834d248"}
Sep 08 00:17:33.703366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.703314    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podStartSLOduration=2.7032987459999998 podStartE2EDuration="2.703298746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:33.701615417 +0000 UTC m=+896.452312252" watchObservedRunningTime="2026-09-08 00:17:33.703298746 +0000 UTC m=+896.453995590"
Sep 08 00:17:33.757176 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.757138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc2vv\" (UniqueName: \"kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv\") pod \"test-curl-7868-140045380027696\" (UID: \"8b99fad7-8a3e-44a7-ba53-c9e59376c84e\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:33.857887 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.857853    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc2vv\" (UniqueName: \"kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv\") pod \"test-curl-7868-140045380027696\" (UID: \"8b99fad7-8a3e-44a7-ba53-c9e59376c84e\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:33.865936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.865907    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc2vv\" (UniqueName: \"kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv\") pod \"test-curl-7868-140045380027696\" (UID: \"8b99fad7-8a3e-44a7-ba53-c9e59376c84e\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:33.959662 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:33.959576    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:34.230232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.230203    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:34.231829 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:34.231792    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8b99fad7_8a3e_44a7_ba53_c9e59376c84e.slice/crio-802c32f669ca21e030bcfeb3e7d7d8b0a8c9736a04116ccd3c17dfff51a42340 WatchSource:0}: Error finding container 802c32f669ca21e030bcfeb3e7d7d8b0a8c9736a04116ccd3c17dfff51a42340: Status 404 returned error can't find the container with id 802c32f669ca21e030bcfeb3e7d7d8b0a8c9736a04116ccd3c17dfff51a42340
Sep 08 00:17:34.335779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.335735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:34.341036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.341004    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:34.691281 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.691184    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-140045380027696" event={"ID":"8b99fad7-8a3e-44a7-ba53-c9e59376c84e","Type":"ContainerStarted","Data":"802c32f669ca21e030bcfeb3e7d7d8b0a8c9736a04116ccd3c17dfff51a42340"}
Sep 08 00:17:34.691711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.691489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:34.692394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:34.692378    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:36.145118 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:36.145074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:17:36.708319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:36.708221    2580 generic.go:356] "Generic (PLEG): container finished" podID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" containerID="e478a19245b1cb4aa2bc3655f9c91aa1002a32b740a4524ab8b97119c955dd0a" exitCode=0
Sep 08 00:17:36.708500 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:36.708303    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-140045380027696" event={"ID":"8b99fad7-8a3e-44a7-ba53-c9e59376c84e","Type":"ContainerDied","Data":"e478a19245b1cb4aa2bc3655f9c91aa1002a32b740a4524ab8b97119c955dd0a"}
Sep 08 00:17:37.785319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.785287    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:17:37.786097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.786075    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:17:37.886528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.886494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:37.916308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.916276    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7868-140045380027696_8b99fad7-8a3e-44a7-ba53-c9e59376c84e/test-curl-7868-140045380027696/0.log"
Sep 08 00:17:37.938171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.938136    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:37.940591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:37.940564    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:38.001207 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.001122    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zc2vv\" (UniqueName: \"kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv\") pod \"8b99fad7-8a3e-44a7-ba53-c9e59376c84e\" (UID: \"8b99fad7-8a3e-44a7-ba53-c9e59376c84e\") "
Sep 08 00:17:38.003272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.003244    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv" (OuterVolumeSpecName: "kube-api-access-zc2vv") pod "8b99fad7-8a3e-44a7-ba53-c9e59376c84e" (UID: "8b99fad7-8a3e-44a7-ba53-c9e59376c84e"). InnerVolumeSpecName "kube-api-access-zc2vv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:17:38.057078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.057041    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:38.057496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.057482    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:38.057545 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.057498    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:38.057582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.057560    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:38.060711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.060694    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.065717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.065685    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:38.102283 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.102246    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zc2vv\" (UniqueName: \"kubernetes.io/projected/8b99fad7-8a3e-44a7-ba53-c9e59376c84e-kube-api-access-zc2vv\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:17:38.203557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.203515    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj7dx\" (UniqueName: \"kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx\") pod \"test-curl-7868-140045380027696\" (UID: \"460b78a9-9362-404e-911c-f9a3d7f1f165\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.304348 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.304226    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj7dx\" (UniqueName: \"kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx\") pod \"test-curl-7868-140045380027696\" (UID: \"460b78a9-9362-404e-911c-f9a3d7f1f165\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.311637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.311605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj7dx\" (UniqueName: \"kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx\") pod \"test-curl-7868-140045380027696\" (UID: \"460b78a9-9362-404e-911c-f9a3d7f1f165\") " pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.372695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.372649    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.649104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.649070    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:38.650562 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:38.650535    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod460b78a9_9362_404e_911c_f9a3d7f1f165.slice/crio-9f095cd5111fc8e05740f6868b44052977045b2a68fb26317e8440dae5e952be WatchSource:0}: Error finding container 9f095cd5111fc8e05740f6868b44052977045b2a68fb26317e8440dae5e952be: Status 404 returned error can't find the container with id 9f095cd5111fc8e05740f6868b44052977045b2a68fb26317e8440dae5e952be
Sep 08 00:17:38.723952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.723925    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:38.724162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.723967    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="802c32f669ca21e030bcfeb3e7d7d8b0a8c9736a04116ccd3c17dfff51a42340"
Sep 08 00:17:38.725795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.725753    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-140045380027696" event={"ID":"460b78a9-9362-404e-911c-f9a3d7f1f165","Type":"ContainerStarted","Data":"9f095cd5111fc8e05740f6868b44052977045b2a68fb26317e8440dae5e952be"}
Sep 08 00:17:38.735631 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:38.735594    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7868-140045380027696" oldPodUID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165"
Sep 08 00:17:39.734170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:39.734135    2580 generic.go:356] "Generic (PLEG): container finished" podID="460b78a9-9362-404e-911c-f9a3d7f1f165" containerID="072f8957a704444f3218b341f2153598e43edcdbdd7328b95ec5dc2ba3599258" exitCode=0
Sep 08 00:17:39.734607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:39.734229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7868-140045380027696" event={"ID":"460b78a9-9362-404e-911c-f9a3d7f1f165","Type":"ContainerDied","Data":"072f8957a704444f3218b341f2153598e43edcdbdd7328b95ec5dc2ba3599258"}
Sep 08 00:17:39.774862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:39.774771    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b99fad7-8a3e-44a7-ba53-c9e59376c84e" path="/var/lib/kubelet/pods/8b99fad7-8a3e-44a7-ba53-c9e59376c84e/volumes"
Sep 08 00:17:40.022523 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.022479    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:17:40.027744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.027146    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.029518 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.029444    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-46c5cdbb-openshift-default-dockercfg-dkb8g\""
Sep 08 00:17:40.037980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.037933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:17:40.122415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122302    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122354    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122440    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122513    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl7hv\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122552    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.122865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.122602    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224072 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224026    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224072 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224076    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224102    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224126    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224155    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl7hv\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224255    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224308    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224424    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.224978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.224951    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.225200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.225178    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.225368 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.225349    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.225446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.225417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.226932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.226908    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.227088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.227068    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.239785 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.239744    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.240080 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.240055    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl7hv\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv\") pod \"e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") " pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.343291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.343182    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:40.626429 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.626384    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:17:40.628079 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:40.628046    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3cd22c_4629_4dd3_ba78_943462ce86b7.slice/crio-308093263e7db37abfda57b374b8eb020e01050245254938a3e19dc8a6adc0c4 WatchSource:0}: Error finding container 308093263e7db37abfda57b374b8eb020e01050245254938a3e19dc8a6adc0c4: Status 404 returned error can't find the container with id 308093263e7db37abfda57b374b8eb020e01050245254938a3e19dc8a6adc0c4
Sep 08 00:17:40.630942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.630908    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:40.631050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.630978    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:40.631050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.631010    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:40.746307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.746190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerStarted","Data":"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"}
Sep 08 00:17:40.746307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.746262    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerStarted","Data":"308093263e7db37abfda57b374b8eb020e01050245254938a3e19dc8a6adc0c4"}
Sep 08 00:17:40.763869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.763796    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podStartSLOduration=0.763775975 podStartE2EDuration="763.775975ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:40.762754495 +0000 UTC m=+903.513451340" watchObservedRunningTime="2026-09-08 00:17:40.763775975 +0000 UTC m=+903.514472830"
Sep 08 00:17:40.903406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.903373    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:40.928478 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.927705    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7868-140045380027696_460b78a9-9362-404e-911c-f9a3d7f1f165/test-curl-7868-140045380027696/0.log"
Sep 08 00:17:40.951326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.951294    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:40.954579 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:40.954545    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7868-140045380027696"]
Sep 08 00:17:41.032694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.032657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lj7dx\" (UniqueName: \"kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx\") pod \"460b78a9-9362-404e-911c-f9a3d7f1f165\" (UID: \"460b78a9-9362-404e-911c-f9a3d7f1f165\") "
Sep 08 00:17:41.034844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.034804    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx" (OuterVolumeSpecName: "kube-api-access-lj7dx") pod "460b78a9-9362-404e-911c-f9a3d7f1f165" (UID: "460b78a9-9362-404e-911c-f9a3d7f1f165"). InnerVolumeSpecName "kube-api-access-lj7dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:17:41.134064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.134018    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lj7dx\" (UniqueName: \"kubernetes.io/projected/460b78a9-9362-404e-911c-f9a3d7f1f165-kube-api-access-lj7dx\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:17:41.343925 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.343878    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:41.349592 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.349566    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:41.739974 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.739933    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:17:41.740479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.740433    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:41.740479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.740471    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:41.740650 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.740562    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165" containerName="test-curl-7868-140045380027696"
Sep 08 00:17:41.743911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.743881    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.746137 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.746108    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-90b207-openshift-default-dockercfg-bpr4g\""
Sep 08 00:17:41.757015 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.756985    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:17:41.757494 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.757474    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:41.757554 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.757491    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f095cd5111fc8e05740f6868b44052977045b2a68fb26317e8440dae5e952be"
Sep 08 00:17:41.757808 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.757793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:41.759502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.759440    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:17:41.775850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.775816    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165" path="/var/lib/kubelet/pods/460b78a9-9362-404e-911c-f9a3d7f1f165/volumes"
Sep 08 00:17:41.787384 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:17:41.787344    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7868-140045380027696\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="460b78a9-9362-404e-911c-f9a3d7f1f165" pod="opendatahub/test-curl-7868-140045380027696"
Sep 08 00:17:41.841221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841243    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841286    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841310    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841349    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841580    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841728    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9k87\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.841858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.841841    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943290    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943409    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943465    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9k87\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943520    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943807    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943838    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.943913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.943874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.944281 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.944234    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.944599 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.944574    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.944735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.944684    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.944952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.944933    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.947103 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.947066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.947254 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.947167    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.951605 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.951577    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:41.952125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:41.952103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9k87\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87\") pod \"e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") " pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:42.060336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.060226    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:42.354179 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.354146    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:17:42.358714 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:42.358669    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485f7017_be4d_404a_8261_eb99780dc777.slice/crio-932e4977ea8820e10c11c2a978e3320094ef144bcd03b7138669003de0320aae WatchSource:0}: Error finding container 932e4977ea8820e10c11c2a978e3320094ef144bcd03b7138669003de0320aae: Status 404 returned error can't find the container with id 932e4977ea8820e10c11c2a978e3320094ef144bcd03b7138669003de0320aae
Sep 08 00:17:42.362068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.362021    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:42.362185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.362127    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:42.362185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.362171    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:42.769252 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.769211    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerStarted","Data":"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"}
Sep 08 00:17:42.769806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.769269    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerStarted","Data":"932e4977ea8820e10c11c2a978e3320094ef144bcd03b7138669003de0320aae"}
Sep 08 00:17:42.792478 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:42.792390    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podStartSLOduration=1.792364413 podStartE2EDuration="1.792364413s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:42.787940496 +0000 UTC m=+905.538637342" watchObservedRunningTime="2026-09-08 00:17:42.792364413 +0000 UTC m=+905.543061258"
Sep 08 00:17:43.063445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:43.063339    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:17:43.063668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:43.063554    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:17:43.063933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:43.063902    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:44.066296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:44.066270    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:44.785832 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:44.785799    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:44.786876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:44.786849    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:17:46.543474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.543379    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:17:46.558144 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.556436    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.559508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.559439    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-90b207-dockercfg-hj9v4\""
Sep 08 00:17:46.559684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.559527    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-90b207\""
Sep 08 00:17:46.560808 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.560782    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:17:46.699756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.699707    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.699962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.699934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzv74\" (UniqueName: \"kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.801327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.801218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzv74\" (UniqueName: \"kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.801327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.801264    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.802022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.801998    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.808735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.808703    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzv74\" (UniqueName: \"kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74\") pod \"payload-processing-e2e-autores-90b207-7ff98499c-r5svs\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") " pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:46.871604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:46.871565    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:47.171896 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:47.171865    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:17:47.174001 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:17:47.173959    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e3ce7e_5fec_40fc_9dae_9f7a37964794.slice/crio-b578ac1c2bf5a49753d3c9a2141818f5d7e628e9e49b63eb879d53916b265e8b WatchSource:0}: Error finding container b578ac1c2bf5a49753d3c9a2141818f5d7e628e9e49b63eb879d53916b265e8b: Status 404 returned error can't find the container with id b578ac1c2bf5a49753d3c9a2141818f5d7e628e9e49b63eb879d53916b265e8b
Sep 08 00:17:47.807058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:47.807007    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" event={"ID":"59e3ce7e-5fec-40fc-9dae-9f7a37964794","Type":"ContainerStarted","Data":"b578ac1c2bf5a49753d3c9a2141818f5d7e628e9e49b63eb879d53916b265e8b"}
Sep 08 00:17:49.826079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:49.826031    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" event={"ID":"59e3ce7e-5fec-40fc-9dae-9f7a37964794","Type":"ContainerStarted","Data":"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"}
Sep 08 00:17:49.826669 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:49.826205    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:17:49.840280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:49.840225    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" podStartSLOduration=1.843813392 podStartE2EDuration="3.84020695s" totalImagesPullingTime="1.996393558s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:17:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:17:49.839172104 +0000 UTC m=+912.589868949" watchObservedRunningTime="2026-09-08 00:17:49.84020695 +0000 UTC m=+912.590903794"
Sep 08 00:17:50.181308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:50.181205    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:17:50.734640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:50.734603    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:17:50.734871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:50.734687    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:17:51.845356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.845305    2580 generic.go:356] "Generic (PLEG): container finished" podID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerID="287fe7abff594d9dc287c8eff53d26408c6280892fdf99c1b5db2e80b834d248" exitCode=0
Sep 08 00:17:51.846061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.845408    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerDied","Data":"287fe7abff594d9dc287c8eff53d26408c6280892fdf99c1b5db2e80b834d248"}
Sep 08 00:17:51.847486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.846701    2580 scope.go:117] "RemoveContainer" containerID="287fe7abff594d9dc287c8eff53d26408c6280892fdf99c1b5db2e80b834d248"
Sep 08 00:17:51.849501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.848570    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:51.849501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.848675    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:51.849501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:51.848747    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:17:52.859582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:52.859537    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerStarted","Data":"ae2d1c20422a502e6a3b0bed01f90876edc7b00818e84e9b9aa776d6c00dcdca"}
Sep 08 00:17:53.335911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:53.335856    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:53.336386 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:53.336359    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:53.336646 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:53.336598    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:54.335561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:54.335520    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:54.336186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:54.336149    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:55.335966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:55.335916    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:55.336532 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:55.335997    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:56.336270 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:56.336215    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:56.336871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:56.336300    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:57.335782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:57.335729    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:57.336025 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:57.335808    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:58.335960 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:58.335497    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 08 00:17:58.335960 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:58.335566    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 08 00:17:59.391430 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:59.391395    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:59.391918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:59.391831    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:17:59.392752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:17:59.392726    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:18:00.827752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:00.827689    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:18:00.828330 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:00.827783    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:18:00.835159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:00.835122    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:18:01.076573 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.076532    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:18:01.088310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.087786    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:18:01.088310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.087925    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.090890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.090860    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-c4541b-openshift-default-dockercfg-kljl7\""
Sep 08 00:18:01.176810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.176672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.176810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.176731    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.176810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.176777    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.176934    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.177018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwglq\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.177051    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.177148    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.177195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.179935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.177220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278198    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278272    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278302    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278322    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwglq\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278340    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278856 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278702    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278856 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278774    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.278856 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278842    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.279000 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.278869    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.279207 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.279184    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.279288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.279185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.279288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.279244    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.279402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.279314    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.281368 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.281347    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.281590 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.281570    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.285877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.285848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.286032 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.286008    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwglq\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq\") pod \"e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") " pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.402601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.402495    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:01.685211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.685180    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:18:01.687069 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:18:01.687022    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfb54234_9492_42aa_b16b_00cddea90b4a.slice/crio-263028513a4baa4404b14a02e6149537bb9766989461d0eaf29528f277a16c95 WatchSource:0}: Error finding container 263028513a4baa4404b14a02e6149537bb9766989461d0eaf29528f277a16c95: Status 404 returned error can't find the container with id 263028513a4baa4404b14a02e6149537bb9766989461d0eaf29528f277a16c95
Sep 08 00:18:01.689846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.689792    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.689966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.689900    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.689966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.689954    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.936933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.936828    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerStarted","Data":"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"}
Sep 08 00:18:01.936933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.936894    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerStarted","Data":"263028513a4baa4404b14a02e6149537bb9766989461d0eaf29528f277a16c95"}
Sep 08 00:18:01.938786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.938754    2580 generic.go:356] "Generic (PLEG): container finished" podID="485f7017-be4d-404a-8261-eb99780dc777" containerID="44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5" exitCode=0
Sep 08 00:18:01.938916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.938826    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerDied","Data":"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"}
Sep 08 00:18:01.939240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.939224    2580 scope.go:117] "RemoveContainer" containerID="44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"
Sep 08 00:18:01.940752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.940711    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.940898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.940796    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.940898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.940842    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.941217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.941198    2580 generic.go:356] "Generic (PLEG): container finished" podID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerID="74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95" exitCode=0
Sep 08 00:18:01.941294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.941229    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerDied","Data":"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"}
Sep 08 00:18:01.941652 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.941638    2580 scope.go:117] "RemoveContainer" containerID="74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"
Sep 08 00:18:01.942765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.942738    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.942880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.942815    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.942880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.942847    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:01.959338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:01.959268    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podStartSLOduration=0.959250154 podStartE2EDuration="959.250154ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:01.955069202 +0000 UTC m=+924.705766046" watchObservedRunningTime="2026-09-08 00:18:01.959250154 +0000 UTC m=+924.709946995"
Sep 08 00:18:02.402820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.402772    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:02.408279 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.408251    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:02.959475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.957740    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerStarted","Data":"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"}
Sep 08 00:18:02.963477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.962472    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerStarted","Data":"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"}
Sep 08 00:18:02.963477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.963111    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:02.967783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:02.967755    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:03.064049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.064009    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:03.064383 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.064332    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:03.065024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.065005    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:18:03.344811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.344323    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:03.344811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.344475    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:03.344811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:03.344523    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:04.061696 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:04.061644    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:04.062235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:04.061720    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:04.344319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:04.344205    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:04.344319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:04.344279    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:05.061719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:05.061668    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:05.062284 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:05.061745    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:05.344138 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:05.344027    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:05.344138 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:05.344098    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:06.060752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:06.060703    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:06.060979 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:06.060776    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:06.349539 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:06.343858    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:06.349539 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:06.343922    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:07.061744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.061694    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:07.061977 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.061770    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:07.344009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.343901    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:07.344293 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.344260    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:07.560385 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.560337    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"]
Sep 08 00:18:07.590477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.589876    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"]
Sep 08 00:18:07.590477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.590044    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:07.594576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.594397    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:18:07.594576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.594492    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:18:07.672146 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.672095    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm\" (UID: \"74c98a79-a2fd-4295-a8ad-82e970e38a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:07.776191 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.776142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm\" (UID: \"74c98a79-a2fd-4295-a8ad-82e970e38a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:07.777406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.777253    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm\" (UID: \"74c98a79-a2fd-4295-a8ad-82e970e38a5f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:07.905160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:07.905085    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:08.065402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:08.064862    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 00:18:08.065402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:08.064940    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 00:18:08.263867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:08.263653    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"]
Sep 08 00:18:08.266748 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:18:08.266712    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c98a79_a2fd_4295_a8ad_82e970e38a5f.slice/crio-cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902 WatchSource:0}: Error finding container cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902: Status 404 returned error can't find the container with id cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902
Sep 08 00:18:08.344253 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:08.344220    2580 patch_prober.go:28] interesting pod/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 08 00:18:08.344507 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:08.344276    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 08 00:18:09.012922 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.012881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm" event={"ID":"74c98a79-a2fd-4295-a8ad-82e970e38a5f","Type":"ContainerStarted","Data":"e347f4ff7554a2983e9b9b7005d1df16954668822a2df9802639fa376fdc38a2"}
Sep 08 00:18:09.013323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.012949    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm" event={"ID":"74c98a79-a2fd-4295-a8ad-82e970e38a5f","Type":"ContainerStarted","Data":"cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902"}
Sep 08 00:18:09.030154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.030093    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm" podStartSLOduration=2.030073428 podStartE2EDuration="2.030073428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:09.027572102 +0000 UTC m=+931.778268959" watchObservedRunningTime="2026-09-08 00:18:09.030073428 +0000 UTC m=+931.780770272"
Sep 08 00:18:09.064762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.064727    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:18:09.065200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.065178    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:18:09.065943 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.065919    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:18:09.349288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.349192    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:09.349602 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.349582    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:09.350398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:09.350377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:10.020525 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:10.020489    2580 generic.go:356] "Generic (PLEG): container finished" podID="74c98a79-a2fd-4295-a8ad-82e970e38a5f" containerID="e347f4ff7554a2983e9b9b7005d1df16954668822a2df9802639fa376fdc38a2" exitCode=0
Sep 08 00:18:10.021044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:10.020571    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm" event={"ID":"74c98a79-a2fd-4295-a8ad-82e970e38a5f","Type":"ContainerDied","Data":"e347f4ff7554a2983e9b9b7005d1df16954668822a2df9802639fa376fdc38a2"}
Sep 08 00:18:11.178541 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:11.178510    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:11.320347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:11.320254    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca\") pod \"74c98a79-a2fd-4295-a8ad-82e970e38a5f\" (UID: \"74c98a79-a2fd-4295-a8ad-82e970e38a5f\") "
Sep 08 00:18:11.320694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:11.320668    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "74c98a79-a2fd-4295-a8ad-82e970e38a5f" (UID: "74c98a79-a2fd-4295-a8ad-82e970e38a5f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:11.421173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:11.421130    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/74c98a79-a2fd-4295-a8ad-82e970e38a5f-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:11.878697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:11.878656    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:18:12.035638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:12.035562    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"
Sep 08 00:18:12.035779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:12.035557    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm" event={"ID":"74c98a79-a2fd-4295-a8ad-82e970e38a5f","Type":"ContainerDied","Data":"cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902"}
Sep 08 00:18:12.035779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:12.035689    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbd5fa858df9ebfa7127b7b6f2fc05ec023357eb36845ea0ce86b2b2fa03c902"
Sep 08 00:18:14.559956 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:14.559900    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"]
Sep 08 00:18:14.563106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:14.563073    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-46c5cdbb-f99pm"]
Sep 08 00:18:14.689608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:14.689564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:18:14.689953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:14.689910    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy" containerID="cri-o://35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228" gracePeriod=30
Sep 08 00:18:15.594913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.594875    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:15.595411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.595393    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c98a79-a2fd-4295-a8ad-82e970e38a5f" containerName="revoke-keys"
Sep 08 00:18:15.595601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.595412    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c98a79-a2fd-4295-a8ad-82e970e38a5f" containerName="revoke-keys"
Sep 08 00:18:15.595601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.595521    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="74c98a79-a2fd-4295-a8ad-82e970e38a5f" containerName="revoke-keys"
Sep 08 00:18:15.598962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.598941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.602309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.602287    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-693d9ea3-gw-openshift-default-dockercfg-mqpc2\""
Sep 08 00:18:15.612445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.612413    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:15.674713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674671    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.674889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674743    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.674889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674767    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.674889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98hwp\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.674889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674809    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.674889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674827    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.675116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674903    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.675116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.675116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.674967    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775500    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c98a79-a2fd-4295-a8ad-82e970e38a5f" path="/var/lib/kubelet/pods/74c98a79-a2fd-4295-a8ad-82e970e38a5f/volumes"
Sep 08 00:18:15.775726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775678    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98hwp\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775698    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775714    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775813    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775846    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.775931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775874    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.775989    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776089    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776136    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776426    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776712    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.776895 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.776846    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.778246 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.778210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.778706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.778688    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.783441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.783417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.783589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.783572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98hwp\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp\") pod \"e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") " pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:15.914021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:15.913912    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:16.221849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:16.221807    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:16.225498 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:18:16.224221    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7013bc5a_20fe_4a27_b103_370028c0ef7d.slice/crio-208b09f8f2dea6dd4873bb45825309aab881a43acbb672fde95fab31fc1858fa WatchSource:0}: Error finding container 208b09f8f2dea6dd4873bb45825309aab881a43acbb672fde95fab31fc1858fa: Status 404 returned error can't find the container with id 208b09f8f2dea6dd4873bb45825309aab881a43acbb672fde95fab31fc1858fa
Sep 08 00:18:16.235062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:16.233272    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:16.235062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:16.233485    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:16.235062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:16.233563    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:17.076746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:17.076705    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerStarted","Data":"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"}
Sep 08 00:18:17.077153 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:17.076765    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerStarted","Data":"208b09f8f2dea6dd4873bb45825309aab881a43acbb672fde95fab31fc1858fa"}
Sep 08 00:18:17.097909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:17.097848    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podStartSLOduration=2.09782789 podStartE2EDuration="2.09782789s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:17.095790665 +0000 UTC m=+939.846487509" watchObservedRunningTime="2026-09-08 00:18:17.09782789 +0000 UTC m=+939.848524733"
Sep 08 00:18:17.914980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:17.914942    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:17.920517 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:17.920489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:18.083516 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:18.083484    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:18.084648 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:18.084625    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:19.985169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:19.985123    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024221    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024291    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl7hv\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024388    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024443    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024531    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024564    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.024664    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token\") pod \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\" (UID: \"1c3cd22c-4629-4dd3-ba78-943462ce86b7\") "
Sep 08 00:18:20.026078 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.025746    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:20.027108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.026120    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:20.027108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.026414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:20.027108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.026841    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:20.027658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.027307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:20.033974 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.033914    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:20.034282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.034217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv" (OuterVolumeSpecName: "kube-api-access-zl7hv") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "kube-api-access-zl7hv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:20.035580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.035547    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:18:20.036039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.036002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c3cd22c-4629-4dd3-ba78-943462ce86b7" (UID: "1c3cd22c-4629-4dd3-ba78-943462ce86b7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:20.097890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.097854    2580 generic.go:356] "Generic (PLEG): container finished" podID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerID="35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228" exitCode=0
Sep 08 00:18:20.098092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.097903    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"
Sep 08 00:18:20.098092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.097951    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerDied","Data":"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"}
Sep 08 00:18:20.098092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.098018    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt" event={"ID":"1c3cd22c-4629-4dd3-ba78-943462ce86b7","Type":"ContainerDied","Data":"308093263e7db37abfda57b374b8eb020e01050245254938a3e19dc8a6adc0c4"}
Sep 08 00:18:20.098092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.098057    2580 scope.go:117] "RemoveContainer" containerID="35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"
Sep 08 00:18:20.108831 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.108813    2580 scope.go:117] "RemoveContainer" containerID="74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"
Sep 08 00:18:20.118947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.118920    2580 scope.go:117] "RemoveContainer" containerID="35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"
Sep 08 00:18:20.123070 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.123031    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:18:20.123426 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:18:20.123399    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228\": container with ID starting with 35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228 not found: ID does not exist" containerID="35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"
Sep 08 00:18:20.124998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.124950    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228"} err="failed to get container status \"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228\": rpc error: code = NotFound desc = could not find container \"35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228\": container with ID starting with 35f9d669a36ff9a3ee0c9fe3f738afc842eaa03a91145dbd51158cf45e953228 not found: ID does not exist"
Sep 08 00:18:20.125215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.125197    2580 scope.go:117] "RemoveContainer" containerID="74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126140    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126169    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126184    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126197    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126213    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl7hv\" (UniqueName: \"kubernetes.io/projected/1c3cd22c-4629-4dd3-ba78-943462ce86b7-kube-api-access-zl7hv\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126228    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126242    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126258    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.126271    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c3cd22c-4629-4dd3-ba78-943462ce86b7-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:20.127800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.127771    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-46c5cdbb-openshift-default-654b64c4c8-9xqqt"]
Sep 08 00:18:20.127990 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:18:20.127799    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95\": container with ID starting with 74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95 not found: ID does not exist" containerID="74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"
Sep 08 00:18:20.128124 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:20.128099    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95"} err="failed to get container status \"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95\": rpc error: code = NotFound desc = could not find container \"74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95\": container with ID starting with 74934c6036847601b201fc0028179d1d71c003c3518fc3b60760e26e9e59fb95 not found: ID does not exist"
Sep 08 00:18:21.774396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:21.774363    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" path="/var/lib/kubelet/pods/1c3cd22c-4629-4dd3-ba78-943462ce86b7/volumes"
Sep 08 00:18:22.116697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.116594    2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerID="4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6" exitCode=0
Sep 08 00:18:22.116697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.116666    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerDied","Data":"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"}
Sep 08 00:18:22.117099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.117085    2580 scope.go:117] "RemoveContainer" containerID="4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"
Sep 08 00:18:22.118222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.118193    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:22.118293 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.118279    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:22.118333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:22.118317    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:23.129609 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:23.129567    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerStarted","Data":"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"}
Sep 08 00:18:23.403146 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:23.403048    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:23.403342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:23.403317    2580 patch_prober.go:28] interesting pod/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:18:23.403402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:23.403383    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 00:18:24.402941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:24.402902    2580 patch_prober.go:28] interesting pod/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:18:24.403479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:24.402981    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 00:18:25.403206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:25.403163    2580 patch_prober.go:28] interesting pod/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:18:25.403665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:25.403230    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 00:18:26.403689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:26.403652    2580 patch_prober.go:28] interesting pod/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:18:26.404131 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:26.403727    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 00:18:27.403503 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:27.403444    2580 patch_prober.go:28] interesting pod/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 08 00:18:27.403717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:27.403520    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 08 00:18:28.701617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:28.701579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:28.702181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:28.702154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:28.703730 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:28.703702    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:18:34.124649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:34.124604    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:18:34.125112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:34.124683    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:18:37.244196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.244157    2580 generic.go:356] "Generic (PLEG): container finished" podID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerID="9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1" exitCode=0
Sep 08 00:18:37.244724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.244230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerDied","Data":"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"}
Sep 08 00:18:37.244779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.244742    2580 scope.go:117] "RemoveContainer" containerID="9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"
Sep 08 00:18:37.245937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.245903    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:37.246009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.245979    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:37.246046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:37.246012    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:38.256541 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:38.256499    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerStarted","Data":"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"}
Sep 08 00:18:38.914724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:38.914683    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:38.914938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:38.914914    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 00:18:38.914990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:38.914967    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 00:18:39.492474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:39.488542    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:18:39.915277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:39.915178    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 00:18:39.915277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:39.915242    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 00:18:40.915331 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:40.915294    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 00:18:40.915826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:40.915353    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 00:18:41.914493 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:41.914429    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 00:18:41.914711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:41.914518    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 00:18:42.914897 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:42.914860    2580 patch_prober.go:28] interesting pod/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 08 00:18:42.915358 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:42.914934    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 08 00:18:43.428861 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.428804    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"]
Sep 08 00:18:43.429842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.429813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.430025 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.430013    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.430154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.430142    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.430242 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.430232    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.430468 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.430436    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.430604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.430592    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c3cd22c-4629-4dd3-ba78-943462ce86b7" containerName="istio-proxy"
Sep 08 00:18:43.440155 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.440125    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"]
Sep 08 00:18:43.440415 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.440252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:43.443115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.443086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:18:43.443605 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.443586    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:18:43.586819 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.586776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg\" (UID: \"3afe38e8-4d5e-433e-814f-ed9b3131ba2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:43.687833 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.687732    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg\" (UID: \"3afe38e8-4d5e-433e-814f-ed9b3131ba2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:43.688433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.688413    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg\" (UID: \"3afe38e8-4d5e-433e-814f-ed9b3131ba2e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:43.761174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:43.761127    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:44.000618 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:44.000585    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:44.001069 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:44.000983    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:44.001777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:44.001753    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:44.069891 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:44.069857    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"]
Sep 08 00:18:44.071067 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:18:44.071022    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3afe38e8_4d5e_433e_814f_ed9b3131ba2e.slice/crio-ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38 WatchSource:0}: Error finding container ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38: Status 404 returned error can't find the container with id ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38
Sep 08 00:18:44.296440 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:44.296335    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg" event={"ID":"3afe38e8-4d5e-433e-814f-ed9b3131ba2e","Type":"ContainerStarted","Data":"ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38"}
Sep 08 00:18:45.303871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:45.303834    2580 generic.go:356] "Generic (PLEG): container finished" podID="3afe38e8-4d5e-433e-814f-ed9b3131ba2e" containerID="853b991138dbe185d805e93e0865b4563d737b95edc2dffb0fda439521a53efa" exitCode=0
Sep 08 00:18:45.304271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:45.303967    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg" event={"ID":"3afe38e8-4d5e-433e-814f-ed9b3131ba2e","Type":"ContainerDied","Data":"853b991138dbe185d805e93e0865b4563d737b95edc2dffb0fda439521a53efa"}
Sep 08 00:18:46.461157 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:46.461133    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:46.622530 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:46.622387    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca\") pod \"3afe38e8-4d5e-433e-814f-ed9b3131ba2e\" (UID: \"3afe38e8-4d5e-433e-814f-ed9b3131ba2e\") "
Sep 08 00:18:46.622839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:46.622793    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3afe38e8-4d5e-433e-814f-ed9b3131ba2e" (UID: "3afe38e8-4d5e-433e-814f-ed9b3131ba2e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:46.723387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:46.723349    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3afe38e8-4d5e-433e-814f-ed9b3131ba2e-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:47.318195 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:47.318161    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"
Sep 08 00:18:47.318416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:47.318197    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg" event={"ID":"3afe38e8-4d5e-433e-814f-ed9b3131ba2e","Type":"ContainerDied","Data":"ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38"}
Sep 08 00:18:47.318416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:47.318245    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddf27ca78f456a8b851e9d1b6725269095521e848aca2a5c41b7e60aea25cd38"
Sep 08 00:18:49.430338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:49.430112    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"]
Sep 08 00:18:49.433092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:49.433057    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-693d9ea3-6gsfg"]
Sep 08 00:18:49.553214 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:49.553167    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:49.553830 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:49.553787    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy" containerID="cri-o://773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e" gracePeriod=30
Sep 08 00:18:49.779858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:49.779816    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3afe38e8-4d5e-433e-814f-ed9b3131ba2e" path="/var/lib/kubelet/pods/3afe38e8-4d5e-433e-814f-ed9b3131ba2e/volumes"
Sep 08 00:18:50.280791 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.280748    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:18:50.281329 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.281307    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3afe38e8-4d5e-433e-814f-ed9b3131ba2e" containerName="revoke-keys"
Sep 08 00:18:50.281329 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.281330    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3afe38e8-4d5e-433e-814f-ed9b3131ba2e" containerName="revoke-keys"
Sep 08 00:18:50.281544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.281501    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3afe38e8-4d5e-433e-814f-ed9b3131ba2e" containerName="revoke-keys"
Sep 08 00:18:50.285166 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.285136    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.287779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.287753    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-93fccec0-openshift-default-dockercfg-xr4q6\""
Sep 08 00:18:50.299409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.299371    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:18:50.361662 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.361614    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.361853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.361781    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7d8x\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.361853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.361840    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.361935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.361891    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.361986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.361968    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.362024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.362005    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.362064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.362024    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.362153 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.362127    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.362217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.362183    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.463804 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.463762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.463818    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.463855    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.463965    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7d8x\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464016    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464046    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464156    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464271    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464599    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.464933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.464848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.465216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.465189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.467039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.467004    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.467039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.467029    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.478647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.478609    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7d8x\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.479890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.479864    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token\") pod \"e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") " pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.598576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.598433    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:50.895240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.895210    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:18:50.897427 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:18:50.897389    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c25336_a69e_4dbc_b421_36e7405723a3.slice/crio-782837d49c07fc3ebbbba83fa8f5c7cfba663a2a291dc1b0bf772653ee8fb792 WatchSource:0}: Error finding container 782837d49c07fc3ebbbba83fa8f5c7cfba663a2a291dc1b0bf772653ee8fb792: Status 404 returned error can't find the container with id 782837d49c07fc3ebbbba83fa8f5c7cfba663a2a291dc1b0bf772653ee8fb792
Sep 08 00:18:50.900006 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.899966    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:50.900127 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.900071    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:50.900195 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:50.900134    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:18:51.349628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:51.349586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerStarted","Data":"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"}
Sep 08 00:18:51.349834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:51.349690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerStarted","Data":"782837d49c07fc3ebbbba83fa8f5c7cfba663a2a291dc1b0bf772653ee8fb792"}
Sep 08 00:18:51.367898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:51.367839    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podStartSLOduration=1.367821075 podStartE2EDuration="1.367821075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:18:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:18:51.366264858 +0000 UTC m=+974.116961699" watchObservedRunningTime="2026-09-08 00:18:51.367821075 +0000 UTC m=+974.118517919"
Sep 08 00:18:51.599378 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:51.599336    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:51.604935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:51.604852    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:52.357020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:52.356975    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:52.358204 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:52.358181    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:18:54.853724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.853652    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:54.916890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.916846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.916970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98hwp\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917037    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917077    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917120    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917148    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917184    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917247    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data\") pod \"7013bc5a-20fe-4a27-b103-370028c0ef7d\" (UID: \"7013bc5a-20fe-4a27-b103-370028c0ef7d\") "
Sep 08 00:18:54.917326 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917312    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:54.917677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917511    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:54.917677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917543    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:18:54.917789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917717    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:54.917965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917944    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:54.918045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917970    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:54.918045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917982    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:54.918045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.917993    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:54.918045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.918001    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7013bc5a-20fe-4a27-b103-370028c0ef7d-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:54.919854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.919819    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:18:54.920036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.920003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:54.920130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.920078    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:18:54.920171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:54.920135    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp" (OuterVolumeSpecName: "kube-api-access-98hwp") pod "7013bc5a-20fe-4a27-b103-370028c0ef7d" (UID: "7013bc5a-20fe-4a27-b103-370028c0ef7d"). InnerVolumeSpecName "kube-api-access-98hwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:18:55.019052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.019004    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98hwp\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-kube-api-access-98hwp\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:55.019052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.019044    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:55.019052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.019054    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:55.019052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.019062    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7013bc5a-20fe-4a27-b103-370028c0ef7d-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:18:55.378038 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.377994    2580 generic.go:356] "Generic (PLEG): container finished" podID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerID="773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e" exitCode=0
Sep 08 00:18:55.378277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.378053    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"
Sep 08 00:18:55.378277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.378083    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerDied","Data":"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"}
Sep 08 00:18:55.378277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.378171    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj" event={"ID":"7013bc5a-20fe-4a27-b103-370028c0ef7d","Type":"ContainerDied","Data":"208b09f8f2dea6dd4873bb45825309aab881a43acbb672fde95fab31fc1858fa"}
Sep 08 00:18:55.378277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.378205    2580 scope.go:117] "RemoveContainer" containerID="773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"
Sep 08 00:18:55.389408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.389382    2580 scope.go:117] "RemoveContainer" containerID="9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"
Sep 08 00:18:55.400202 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.400177    2580 scope.go:117] "RemoveContainer" containerID="773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"
Sep 08 00:18:55.400648 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:18:55.400620    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e\": container with ID starting with 773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e not found: ID does not exist" containerID="773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"
Sep 08 00:18:55.400758 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.400655    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e"} err="failed to get container status \"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e\": rpc error: code = NotFound desc = could not find container \"773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e\": container with ID starting with 773c1639530130d0b27d4b908228af5fb5adfcf7af9ce27c1fed1009902b362e not found: ID does not exist"
Sep 08 00:18:55.400758 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.400677    2580 scope.go:117] "RemoveContainer" containerID="9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"
Sep 08 00:18:55.400986 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:18:55.400971    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1\": container with ID starting with 9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1 not found: ID does not exist" containerID="9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"
Sep 08 00:18:55.401046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.400990    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1"} err="failed to get container status \"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1\": rpc error: code = NotFound desc = could not find container \"9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1\": container with ID starting with 9f1ba374674e306b441e3490aaf30fcb96e876f1fc49d933f966ab3f35b579a1 not found: ID does not exist"
Sep 08 00:18:55.401046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.401025    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:55.406017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.405990    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-693d9ea3-gw-openshift-default-85d86f4f4d-t4fjj"]
Sep 08 00:18:55.775401 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:55.775362    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" path="/var/lib/kubelet/pods/7013bc5a-20fe-4a27-b103-370028c0ef7d/volumes"
Sep 08 00:18:56.578997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:18:56.578958    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:19:07.800088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:07.799229    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:33514->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Sep 08 00:19:07.800088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:07.799324    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:33514->10.132.0.65:15021: read: connection reset by peer"
Sep 08 00:19:08.478699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.478659    2580 generic.go:356] "Generic (PLEG): container finished" podID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerID="577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063" exitCode=0
Sep 08 00:19:08.478904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.478731    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerDied","Data":"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"}
Sep 08 00:19:08.479219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.479204    2580 scope.go:117] "RemoveContainer" containerID="577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"
Sep 08 00:19:08.480323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.480292    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:08.480383 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.480368    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:08.480418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:08.480401    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:09.488441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:09.488399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerStarted","Data":"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"}
Sep 08 00:19:09.598789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:09.598747    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:09.599048 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:09.599021    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:09.599096 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:09.599079    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:10.599518 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:10.599471    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:10.600018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:10.599986    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:11.599752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:11.599711    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:11.600192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:11.599774    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:12.598985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:12.598934    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:12.599196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:12.599022    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:13.599134 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:13.599092    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:13.599629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:13.599164    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:14.599505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:14.599427    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Sep 08 00:19:14.599953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:14.599516    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Sep 08 00:19:15.635876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:15.635838    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:15.636389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:15.636199    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:15.637322 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:15.637301    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:17.980924 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:17.980872    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:19:18.343292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343176    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"]
Sep 08 00:19:18.343701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343687    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:18.343770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343703    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:18.343770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343721    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:18.343770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343727    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:18.343867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.343793    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:18.347414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.347386    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:18.349702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.349669    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:19:18.349855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.349677    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:19:18.356258 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.356223    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"]
Sep 08 00:19:18.389368 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.389320    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93fccec0-chlrp\" (UID: \"4d660d66-4e0d-4097-af00-6822530b38ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:18.490739 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.490690    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93fccec0-chlrp\" (UID: \"4d660d66-4e0d-4097-af00-6822530b38ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:18.491406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.491381    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-93fccec0-chlrp\" (UID: \"4d660d66-4e0d-4097-af00-6822530b38ad\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:18.663525 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.663419    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:18.951550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:18.951074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"]
Sep 08 00:19:19.557998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:19.557903    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp" event={"ID":"4d660d66-4e0d-4097-af00-6822530b38ad","Type":"ContainerStarted","Data":"4f17fce9f228b52a919a8f8183f28012864532a2fa9b58b874cf86856250b099"}
Sep 08 00:19:19.557998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:19.557956    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp" event={"ID":"4d660d66-4e0d-4097-af00-6822530b38ad","Type":"ContainerStarted","Data":"663ba2c716c2fee369c69680d6782f84bdfd022a4944921c00df5d5763048648"}
Sep 08 00:19:19.574962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:19.574902    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp" podStartSLOduration=1.57488325 podStartE2EDuration="1.57488325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:19.573682326 +0000 UTC m=+1002.324379175" watchObservedRunningTime="2026-09-08 00:19:19.57488325 +0000 UTC m=+1002.325580094"
Sep 08 00:19:20.565849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:20.565813    2580 generic.go:356] "Generic (PLEG): container finished" podID="4d660d66-4e0d-4097-af00-6822530b38ad" containerID="4f17fce9f228b52a919a8f8183f28012864532a2fa9b58b874cf86856250b099" exitCode=0
Sep 08 00:19:20.566356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:20.565885    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp" event={"ID":"4d660d66-4e0d-4097-af00-6822530b38ad","Type":"ContainerDied","Data":"4f17fce9f228b52a919a8f8183f28012864532a2fa9b58b874cf86856250b099"}
Sep 08 00:19:21.726305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:21.726263    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:21.827329 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:21.827228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca\") pod \"4d660d66-4e0d-4097-af00-6822530b38ad\" (UID: \"4d660d66-4e0d-4097-af00-6822530b38ad\") "
Sep 08 00:19:21.827627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:21.827600    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4d660d66-4e0d-4097-af00-6822530b38ad" (UID: "4d660d66-4e0d-4097-af00-6822530b38ad"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:19:21.928155 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:21.928120    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4d660d66-4e0d-4097-af00-6822530b38ad-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:22.579981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:22.579949    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"
Sep 08 00:19:22.580185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:22.579986    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp" event={"ID":"4d660d66-4e0d-4097-af00-6822530b38ad","Type":"ContainerDied","Data":"663ba2c716c2fee369c69680d6782f84bdfd022a4944921c00df5d5763048648"}
Sep 08 00:19:22.580185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:22.580046    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="663ba2c716c2fee369c69680d6782f84bdfd022a4944921c00df5d5763048648"
Sep 08 00:19:24.633005 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:24.632965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"]
Sep 08 00:19:24.635911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:24.635881    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-93fccec0-chlrp"]
Sep 08 00:19:25.729159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:25.729118    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:19:25.729686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:25.729357    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" containerID="cri-o://671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465" gracePeriod=30
Sep 08 00:19:25.774731 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:25.774695    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4d660d66-4e0d-4097-af00-6822530b38ad" path="/var/lib/kubelet/pods/4d660d66-4e0d-4097-af00-6822530b38ad/volumes"
Sep 08 00:19:26.418747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.418711    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:19:26.419282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.419263    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d660d66-4e0d-4097-af00-6822530b38ad" containerName="revoke-keys"
Sep 08 00:19:26.419282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.419283    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d660d66-4e0d-4097-af00-6822530b38ad" containerName="revoke-keys"
Sep 08 00:19:26.419389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.419379    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7013bc5a-20fe-4a27-b103-370028c0ef7d" containerName="istio-proxy"
Sep 08 00:19:26.419426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.419392    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d660d66-4e0d-4097-af00-6822530b38ad" containerName="revoke-keys"
Sep 08 00:19:26.424130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.424088    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.426726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.426695    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-5de06f3e-openshift-default-dockercfg-jbnkm\""
Sep 08 00:19:26.432364 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.432333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:19:26.473755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.473755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473762    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473859    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473879    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6s9j\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.473977    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.474018    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.474068    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.474273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.474107    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.575799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575751    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.575799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575802    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575837    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575862    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575927    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.575963    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576028    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576096    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576123    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6s9j\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576290    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576560 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576419    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576614    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576726    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.576947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.576930    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.578402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.578380    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.578674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.578655    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.583089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.583058    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.583195 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.583160    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6s9j\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j\") pod \"e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") " pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:26.741886 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:26.741841    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:27.024021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.023975    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:19:27.028347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.028309    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:27.028436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.028387    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:27.028436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.028418    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:27.623896 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.623852    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerStarted","Data":"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"}
Sep 08 00:19:27.624224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.624203    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerStarted","Data":"6509cd61573c072dd334bbda9e9be77de26dcfca11c8778f625c8bc762f5cae7"}
Sep 08 00:19:27.643171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.643111    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podStartSLOduration=1.6430909919999999 podStartE2EDuration="1.643090992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:27.640113698 +0000 UTC m=+1010.390810543" watchObservedRunningTime="2026-09-08 00:19:27.643090992 +0000 UTC m=+1010.393787835"
Sep 08 00:19:27.742496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:27.742438    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:28.748414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:28.748381    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:29.642019 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:29.641985    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:29.643221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:29.643190    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:30.638730 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:30.638689    2580 patch_prober.go:28] interesting pod/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:19:30.639148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:30.638755    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:19:31.031134 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.031106    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:31.122641 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122592    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122652    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122702    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122744    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122776    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122818    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7d8x\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.122875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.122863    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.123217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123006    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.123217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123045    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token\") pod \"e7c25336-a69e-4dbc-b421-36e7405723a3\" (UID: \"e7c25336-a69e-4dbc-b421-36e7405723a3\") "
Sep 08 00:19:31.123217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123138    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:19:31.123374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123289    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:19:31.123881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123471    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.123881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123527    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.123881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:19:31.123881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:19:31.123881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.123855    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data" (OuterVolumeSpecName: "istio-data") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:19:31.126733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.126666    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token" (OuterVolumeSpecName: "istio-token") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:19:31.126989 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.126826    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x" (OuterVolumeSpecName: "kube-api-access-j7d8x") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "kube-api-access-j7d8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:19:31.126989 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.126927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:19:31.127353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.127327    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e7c25336-a69e-4dbc-b421-36e7405723a3" (UID: "e7c25336-a69e-4dbc-b421-36e7405723a3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:19:31.224442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224403    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224445    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224492    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224506    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224524    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7d8x\" (UniqueName: \"kubernetes.io/projected/e7c25336-a69e-4dbc-b421-36e7405723a3-kube-api-access-j7d8x\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224540    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7c25336-a69e-4dbc-b421-36e7405723a3-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.224640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.224553    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7c25336-a69e-4dbc-b421-36e7405723a3-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:31.657033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.656936    2580 generic.go:356] "Generic (PLEG): container finished" podID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerID="671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465" exitCode=0
Sep 08 00:19:31.657033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.656986    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"
Sep 08 00:19:31.657552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.657025    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerDied","Data":"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"}
Sep 08 00:19:31.657552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.657077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p" event={"ID":"e7c25336-a69e-4dbc-b421-36e7405723a3","Type":"ContainerDied","Data":"782837d49c07fc3ebbbba83fa8f5c7cfba663a2a291dc1b0bf772653ee8fb792"}
Sep 08 00:19:31.657552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.657100    2580 scope.go:117] "RemoveContainer" containerID="671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"
Sep 08 00:19:31.668143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.668105    2580 scope.go:117] "RemoveContainer" containerID="577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"
Sep 08 00:19:31.678134 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.678111    2580 scope.go:117] "RemoveContainer" containerID="671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"
Sep 08 00:19:31.678550 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:19:31.678507    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465\": container with ID starting with 671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465 not found: ID does not exist" containerID="671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"
Sep 08 00:19:31.684753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.680637    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465"} err="failed to get container status \"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465\": rpc error: code = NotFound desc = could not find container \"671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465\": container with ID starting with 671df0ca80b5f51aa4d6039cabb187b56c5db3ed9acc02e70708f39cd317e465 not found: ID does not exist"
Sep 08 00:19:31.684753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.680717    2580 scope.go:117] "RemoveContainer" containerID="577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"
Sep 08 00:19:31.684753 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:19:31.683101    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063\": container with ID starting with 577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063 not found: ID does not exist" containerID="577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"
Sep 08 00:19:31.684753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.683151    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063"} err="failed to get container status \"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063\": rpc error: code = NotFound desc = could not find container \"577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063\": container with ID starting with 577c49fefb5d0b052bc229d86cf323d4ac0c8a14b5103868b0eaf082f0b43063 not found: ID does not exist"
Sep 08 00:19:31.684753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.683195    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:19:31.687690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.687246    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-93fccec0-openshift-default-6b8dfc8984-fnq7p"]
Sep 08 00:19:31.774978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:31.774940    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" path="/var/lib/kubelet/pods/e7c25336-a69e-4dbc-b421-36e7405723a3/volumes"
Sep 08 00:19:38.078356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:38.078312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:19:48.795988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.795897    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerID="2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892" exitCode=0
Sep 08 00:19:48.795988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.795969    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerDied","Data":"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"}
Sep 08 00:19:48.796478 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.796420    2580 scope.go:117] "RemoveContainer" containerID="2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"
Sep 08 00:19:48.797737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.797703    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:48.797792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.797781    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:48.797826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:48.797815    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:19:49.811983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:49.811939    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerStarted","Data":"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"}
Sep 08 00:19:50.742808 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:50.742756    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:50.743286 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:50.743191    2580 patch_prober.go:28] interesting pod/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 00:19:50.743534 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:50.743502    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 00:19:51.743053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:51.743004    2580 patch_prober.go:28] interesting pod/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 00:19:51.743770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:51.743730    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 00:19:52.742684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:52.742628    2580 patch_prober.go:28] interesting pod/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 00:19:52.742951 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:52.742710    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 00:19:53.742676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.742623    2580 patch_prober.go:28] interesting pod/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 00:19:53.743237 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.742718    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 00:19:53.776421 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.776386    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"]
Sep 08 00:19:53.776885 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.776867    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:53.776885 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.776885    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:53.777058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.776967    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:53.777058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.776978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:53.780395 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.780372    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:53.782560 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.782533    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:19:53.782751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.782601    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:19:53.787515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.787487    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"]
Sep 08 00:19:53.875068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.875013    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl\" (UID: \"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:53.976393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.976342    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl\" (UID: \"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:53.977094 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:53.977064    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl\" (UID: \"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:54.095207 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.095091    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:54.400885 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.400217    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"]
Sep 08 00:19:54.743381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.742833    2580 patch_prober.go:28] interesting pod/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 08 00:19:54.743381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.742912    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 08 00:19:54.865526 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.865490    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl" event={"ID":"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd","Type":"ContainerStarted","Data":"56497d6d5f20a586ddd9ecb286b36a0043c361646553b92144e97af1427699cb"}
Sep 08 00:19:54.865746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.865627    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl" event={"ID":"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd","Type":"ContainerStarted","Data":"e48ec66739f1b44f80357be5bd94cc7a85c6566a21eb8627a52aff03f10d52e7"}
Sep 08 00:19:54.878715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:54.878648    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl" podStartSLOduration=1.8786281379999998 podStartE2EDuration="1.878628138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:54.877984947 +0000 UTC m=+1037.628681783" watchObservedRunningTime="2026-09-08 00:19:54.878628138 +0000 UTC m=+1037.629324981"
Sep 08 00:19:55.747638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.747601    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:55.748191 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.747977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:55.748984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.748958    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:19:55.873601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.873498    2580 generic.go:356] "Generic (PLEG): container finished" podID="40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" containerID="56497d6d5f20a586ddd9ecb286b36a0043c361646553b92144e97af1427699cb" exitCode=0
Sep 08 00:19:55.873601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.873581    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl" event={"ID":"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd","Type":"ContainerDied","Data":"56497d6d5f20a586ddd9ecb286b36a0043c361646553b92144e97af1427699cb"}
Sep 08 00:19:55.977288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:55.977255    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:19:57.067759 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.067701    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:57.109008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.108956    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca\") pod \"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd\" (UID: \"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd\") "
Sep 08 00:19:57.109447 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.109418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" (UID: "40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:19:57.210502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.210386    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:19:57.668355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.668306    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:19:57.669034 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.669009    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" containerName="revoke-keys"
Sep 08 00:19:57.669084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.669041    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" containerName="revoke-keys"
Sep 08 00:19:57.669084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.669074    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:57.669156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.669084    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7c25336-a69e-4dbc-b421-36e7405723a3" containerName="istio-proxy"
Sep 08 00:19:57.669212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.669198    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" containerName="revoke-keys"
Sep 08 00:19:57.672931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.672902    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.675109 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.675074    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-90b207\"/\"openshift-service-ca.crt\""
Sep 08 00:19:57.676060 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.676031    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-90b207\"/\"default-dockercfg-cxtrc\""
Sep 08 00:19:57.676309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.676289    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-90b207\"/\"autores-model-90b207-kserve-self-signed-certs\""
Sep 08 00:19:57.676624 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.676584    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-90b207\"/\"kube-root-ca.crt\""
Sep 08 00:19:57.679513 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.679481    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:19:57.715469 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715426    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.715690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715603    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.715690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715635    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9mxk\" (UniqueName: \"kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.715784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715721    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.715784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.715861 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.715786    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.816675 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816628    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.816881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816684    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.816881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.816881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.816881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816857    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.817120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.816886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9mxk\" (UniqueName: \"kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.817120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.817075    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.817547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.817518    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.817670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.817595    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.819308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.819281    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.819419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.819350    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.824817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.824782    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9mxk\" (UniqueName: \"kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk\") pod \"autores-model-90b207-kserve-579795899f-9l9m8\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") " pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:57.889243 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.889208    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"
Sep 08 00:19:57.889243 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.889237    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl" event={"ID":"40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd","Type":"ContainerDied","Data":"e48ec66739f1b44f80357be5bd94cc7a85c6566a21eb8627a52aff03f10d52e7"}
Sep 08 00:19:57.889502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.889288    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e48ec66739f1b44f80357be5bd94cc7a85c6566a21eb8627a52aff03f10d52e7"
Sep 08 00:19:57.989690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:57.989650    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:19:58.291932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:58.291900    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:19:58.292911 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:19:58.292881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode24409cd_ab3b_4ad8_b6db_94882709b5bb.slice/crio-46bd71ba00205079adc4d75efd7b493eb5ab282ef61ae8fdfe8050d2e86ff904 WatchSource:0}: Error finding container 46bd71ba00205079adc4d75efd7b493eb5ab282ef61ae8fdfe8050d2e86ff904: Status 404 returned error can't find the container with id 46bd71ba00205079adc4d75efd7b493eb5ab282ef61ae8fdfe8050d2e86ff904
Sep 08 00:19:58.898410 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:58.898369    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" event={"ID":"e24409cd-ab3b-4ad8-b6db-94882709b5bb","Type":"ContainerStarted","Data":"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"}
Sep 08 00:19:58.898410 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:58.898414    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" event={"ID":"e24409cd-ab3b-4ad8-b6db-94882709b5bb","Type":"ContainerStarted","Data":"46bd71ba00205079adc4d75efd7b493eb5ab282ef61ae8fdfe8050d2e86ff904"}
Sep 08 00:19:58.915761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:19:58.915697    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" podStartSLOduration=1.9156670409999998 podStartE2EDuration="1.915667041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:19:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:19:58.912562654 +0000 UTC m=+1041.663259496" watchObservedRunningTime="2026-09-08 00:19:58.915667041 +0000 UTC m=+1041.666364184"
Sep 08 00:20:00.876932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:00.876889    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"]
Sep 08 00:20:00.879889 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:00.879853    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-5de06f3e-ddmxl"]
Sep 08 00:20:01.011136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:01.011077    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:20:01.011730 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:01.011688    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy" containerID="cri-o://63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5" gracePeriod=30
Sep 08 00:20:01.774528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:01.774486    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd" path="/var/lib/kubelet/pods/40eba0d3-44ce-4b1a-a8e0-d41ecfcc58cd/volumes"
Sep 08 00:20:06.293921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.293835    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:20:06.407512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407435    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407522    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407568    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407606    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407701    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6s9j\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407725    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.407790 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407766    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token\") pod \"ce63373f-66a4-42ed-ac3e-badb23a850cb\" (UID: \"ce63373f-66a4-42ed-ac3e-badb23a850cb\") "
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407798    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data" (OuterVolumeSpecName: "istio-data") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407888    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.407953    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408025    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:06.408172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:06.408528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408273    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.408528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408292    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.408528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408302    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce63373f-66a4-42ed-ac3e-badb23a850cb-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.408528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408314    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.408528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.408325    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.410004 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.409973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token" (OuterVolumeSpecName: "istio-token") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:06.410143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.410074    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:06.410417 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.410388    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j" (OuterVolumeSpecName: "kube-api-access-d6s9j") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "kube-api-access-d6s9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:06.410539 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.410418    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ce63373f-66a4-42ed-ac3e-badb23a850cb" (UID: "ce63373f-66a4-42ed-ac3e-badb23a850cb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:20:06.509946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.509888    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.509946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.509942    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.509946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.509952    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce63373f-66a4-42ed-ac3e-badb23a850cb-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.509946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.509960    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6s9j\" (UniqueName: \"kubernetes.io/projected/ce63373f-66a4-42ed-ac3e-badb23a850cb-kube-api-access-d6s9j\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:06.956619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.956578    2580 generic.go:356] "Generic (PLEG): container finished" podID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerID="63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5" exitCode=0
Sep 08 00:20:06.956845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.956638    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"
Sep 08 00:20:06.956845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.956662    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerDied","Data":"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"}
Sep 08 00:20:06.956845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.956729    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c" event={"ID":"ce63373f-66a4-42ed-ac3e-badb23a850cb","Type":"ContainerDied","Data":"6509cd61573c072dd334bbda9e9be77de26dcfca11c8778f625c8bc762f5cae7"}
Sep 08 00:20:06.956845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.956761    2580 scope.go:117] "RemoveContainer" containerID="63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"
Sep 08 00:20:06.968051 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.968029    2580 scope.go:117] "RemoveContainer" containerID="2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"
Sep 08 00:20:06.978944 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.978746    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:20:06.978944 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.978929    2580 scope.go:117] "RemoveContainer" containerID="63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"
Sep 08 00:20:06.979420 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:06.979387    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5\": container with ID starting with 63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5 not found: ID does not exist" containerID="63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"
Sep 08 00:20:06.979582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.979430    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5"} err="failed to get container status \"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5\": rpc error: code = NotFound desc = could not find container \"63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5\": container with ID starting with 63a8bfe1f2571ee3faf5d50fe1170a78aaa3083f117b03d4426d70503d6ef4f5 not found: ID does not exist"
Sep 08 00:20:06.979582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.979493    2580 scope.go:117] "RemoveContainer" containerID="2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"
Sep 08 00:20:06.979984 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:06.979961    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892\": container with ID starting with 2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892 not found: ID does not exist" containerID="2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"
Sep 08 00:20:06.980098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.979994    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892"} err="failed to get container status \"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892\": rpc error: code = NotFound desc = could not find container \"2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892\": container with ID starting with 2d54679ef2695951c7166420ec1ace344e1daec6f7ce84215243cea15db00892 not found: ID does not exist"
Sep 08 00:20:06.982912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:06.982885    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-5de06f3e-openshift-default-59c486f4b8-hfp6c"]
Sep 08 00:20:07.775410 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:07.775363    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" path="/var/lib/kubelet/pods/ce63373f-66a4-42ed-ac3e-badb23a850cb/volumes"
Sep 08 00:20:07.990602 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:07.990569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:07.990804 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:07.990619    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:08.003722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:08.003691    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:08.985678 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:08.985637    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:09.570869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:09.570816    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:20:19.199925 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.199883    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:20:19.319152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.319111    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"]
Sep 08 00:20:19.319601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.319586    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:19.319658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.319602    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:19.319695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.319680    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:19.319695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.319689    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:19.326497 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.326445    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:19.329189 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.329144    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:20:19.329416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.329348    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"]
Sep 08 00:20:19.329548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.329538    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:20:19.453687 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.453585    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-90b207-2vdvf\" (UID: \"65afea2b-ef6f-4076-94aa-d11d33729339\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:19.554921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.554875    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-90b207-2vdvf\" (UID: \"65afea2b-ef6f-4076-94aa-d11d33729339\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:19.555576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.555553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-90b207-2vdvf\" (UID: \"65afea2b-ef6f-4076-94aa-d11d33729339\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:19.644121 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.644081    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:19.924822 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:19.924790    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"]
Sep 08 00:20:19.926539 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:20:19.926502    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65afea2b_ef6f_4076_94aa_d11d33729339.slice/crio-e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c WatchSource:0}: Error finding container e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c: Status 404 returned error can't find the container with id e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c
Sep 08 00:20:20.051985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:20.051952    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf" event={"ID":"65afea2b-ef6f-4076-94aa-d11d33729339","Type":"ContainerStarted","Data":"e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c"}
Sep 08 00:20:21.060371 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:21.060334    2580 generic.go:356] "Generic (PLEG): container finished" podID="65afea2b-ef6f-4076-94aa-d11d33729339" containerID="7a3bed3fb15c69a05a28b2e671dbe645bd28d60366e13c6a34becdf4f13d0175" exitCode=0
Sep 08 00:20:21.060807 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:21.060381    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf" event={"ID":"65afea2b-ef6f-4076-94aa-d11d33729339","Type":"ContainerDied","Data":"7a3bed3fb15c69a05a28b2e671dbe645bd28d60366e13c6a34becdf4f13d0175"}
Sep 08 00:20:22.220017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:22.219984    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:22.382572 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:22.382441    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca\") pod \"65afea2b-ef6f-4076-94aa-d11d33729339\" (UID: \"65afea2b-ef6f-4076-94aa-d11d33729339\") "
Sep 08 00:20:22.382848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:22.382825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "65afea2b-ef6f-4076-94aa-d11d33729339" (UID: "65afea2b-ef6f-4076-94aa-d11d33729339"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:22.483867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:22.483832    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/65afea2b-ef6f-4076-94aa-d11d33729339-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:22.771000 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:22.770961    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:20:23.074588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:23.074491    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"
Sep 08 00:20:23.074588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:23.074501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf" event={"ID":"65afea2b-ef6f-4076-94aa-d11d33729339","Type":"ContainerDied","Data":"e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c"}
Sep 08 00:20:23.074588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:23.074556    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e15233940ec2070bc2d8b77017dca3849497b0f78accb63939e2400625b6ad7c"
Sep 08 00:20:29.283050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283011    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:20:29.283882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283430    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65afea2b-ef6f-4076-94aa-d11d33729339" containerName="revoke-keys"
Sep 08 00:20:29.283882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283441    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="65afea2b-ef6f-4076-94aa-d11d33729339" containerName="revoke-keys"
Sep 08 00:20:29.283882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283470    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:29.283882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283477    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce63373f-66a4-42ed-ac3e-badb23a850cb" containerName="istio-proxy"
Sep 08 00:20:29.283882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.283555    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="65afea2b-ef6f-4076-94aa-d11d33729339" containerName="revoke-keys"
Sep 08 00:20:29.286933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.286916    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.289512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.289478    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c4541b\"/\"openshift-service-ca.crt\""
Sep 08 00:20:29.290201 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.290181    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c4541b\"/\"test-model-c4541b-kserve-self-signed-certs\""
Sep 08 00:20:29.290416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.290214    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-c4541b\"/\"default-dockercfg-965kc\""
Sep 08 00:20:29.290570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.290266    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-c4541b\"/\"kube-root-ca.crt\""
Sep 08 00:20:29.293659 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.293632    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:20:29.358615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358578    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.358815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358641    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.358815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358672    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.358815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358715    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.358988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358826    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr5qm\" (UniqueName: \"kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.358988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.358896    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.459676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.459631    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.459676 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.459683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.459917 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.459863    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.459974 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.459930    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.460048 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.460031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr5qm\" (UniqueName: \"kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.460048 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.460040    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.460150 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.460131    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.460245 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.460220    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.460308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.460226    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.462132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.462103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.462562 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.462543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.466875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.466847    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr5qm\" (UniqueName: \"kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm\") pod \"test-model-c4541b-kserve-65cc8d867f-hfr77\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") " pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.598142 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.598033    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:29.816649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.816546    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:20:29.817010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.816955    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" podUID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" containerName="payload-processing" containerID="cri-o://3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e" gracePeriod=30
Sep 08 00:20:29.884758 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.884728    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:20:29.889767 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:20:29.889731    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6ce7999a_5bc9_40ac_9aed_d382264f37f2.slice/crio-a9b884b2b3f1e6544ed25e00a762d30224de453251e730e764f1e2552cc6aaa9 WatchSource:0}: Error finding container a9b884b2b3f1e6544ed25e00a762d30224de453251e730e764f1e2552cc6aaa9: Status 404 returned error can't find the container with id a9b884b2b3f1e6544ed25e00a762d30224de453251e730e764f1e2552cc6aaa9
Sep 08 00:20:29.974438 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.974413    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"]
Sep 08 00:20:29.977513 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:29.977483    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-90b207-2vdvf"]
Sep 08 00:20:30.081348 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.081312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:20:30.125683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.125628    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" event={"ID":"6ce7999a-5bc9-40ac-9aed-d382264f37f2","Type":"ContainerStarted","Data":"0eefa8a64f7e33b01b02e024e3de5e8577065ab4f890778c5a477e207f994ab8"}
Sep 08 00:20:30.125683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.125688    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" event={"ID":"6ce7999a-5bc9-40ac-9aed-d382264f37f2","Type":"ContainerStarted","Data":"a9b884b2b3f1e6544ed25e00a762d30224de453251e730e764f1e2552cc6aaa9"}
Sep 08 00:20:30.127773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.127492    2580 generic.go:356] "Generic (PLEG): container finished" podID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" containerID="3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e" exitCode=0
Sep 08 00:20:30.127773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.127540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" event={"ID":"59e3ce7e-5fec-40fc-9dae-9f7a37964794","Type":"ContainerDied","Data":"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"}
Sep 08 00:20:30.127773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.127586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs" event={"ID":"59e3ce7e-5fec-40fc-9dae-9f7a37964794","Type":"ContainerDied","Data":"b578ac1c2bf5a49753d3c9a2141818f5d7e628e9e49b63eb879d53916b265e8b"}
Sep 08 00:20:30.127773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.127626    2580 scope.go:117] "RemoveContainer" containerID="3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"
Sep 08 00:20:30.128177 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.127815    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"
Sep 08 00:20:30.146726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.146693    2580 scope.go:117] "RemoveContainer" containerID="3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"
Sep 08 00:20:30.147563 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:30.147517    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e\": container with ID starting with 3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e not found: ID does not exist" containerID="3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"
Sep 08 00:20:30.147783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.147753    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e"} err="failed to get container status \"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e\": rpc error: code = NotFound desc = could not find container \"3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e\": container with ID starting with 3d3e41250f0e5f9c0569f6d0e19e278568b2e844e3fe3fe44da55f04ebaf9d1e not found: ID does not exist"
Sep 08 00:20:30.174543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.174483    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume\") pod \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") "
Sep 08 00:20:30.174773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.174599    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzv74\" (UniqueName: \"kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74\") pod \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\" (UID: \"59e3ce7e-5fec-40fc-9dae-9f7a37964794\") "
Sep 08 00:20:30.176184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.176050    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59e3ce7e-5fec-40fc-9dae-9f7a37964794" (UID: "59e3ce7e-5fec-40fc-9dae-9f7a37964794"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:30.178640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.178601    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74" (OuterVolumeSpecName: "kube-api-access-pzv74") pod "59e3ce7e-5fec-40fc-9dae-9f7a37964794" (UID: "59e3ce7e-5fec-40fc-9dae-9f7a37964794"). InnerVolumeSpecName "kube-api-access-pzv74". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:30.275890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.275848    2580 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59e3ce7e-5fec-40fc-9dae-9f7a37964794-plugins-config-volume\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:30.275890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.275882    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzv74\" (UniqueName: \"kubernetes.io/projected/59e3ce7e-5fec-40fc-9dae-9f7a37964794-kube-api-access-pzv74\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:30.461473 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.461402    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" podStartSLOduration=1.461382036 podStartE2EDuration="1.461382036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:20:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:20:30.146277271 +0000 UTC m=+1072.896974116" watchObservedRunningTime="2026-09-08 00:20:30.461382036 +0000 UTC m=+1073.212078888"
Sep 08 00:20:30.465382 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.465350    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:20:30.473862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:30.473833    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-90b207-7ff98499c-r5svs"]
Sep 08 00:20:31.774747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:31.774714    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" path="/var/lib/kubelet/pods/59e3ce7e-5fec-40fc-9dae-9f7a37964794/volumes"
Sep 08 00:20:31.775170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:31.775086    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65afea2b-ef6f-4076-94aa-d11d33729339" path="/var/lib/kubelet/pods/65afea2b-ef6f-4076-94aa-d11d33729339/volumes"
Sep 08 00:20:34.234292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.234230    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" podUID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" containerName="main" containerID="cri-o://b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce" gracePeriod=45
Sep 08 00:20:34.516775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.516744    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:34.623107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623067    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.623334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x9mxk\" (UniqueName: \"kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.623334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623210    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.623334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623274    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.623549 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623332    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.623549 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623370    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir\") pod \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\" (UID: \"e24409cd-ab3b-4ad8-b6db-94882709b5bb\") "
Sep 08 00:20:34.624229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623831    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home" (OuterVolumeSpecName: "home") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:34.624229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.623877    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:34.624229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.624058    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache" (OuterVolumeSpecName: "model-cache") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:34.626180 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.626139    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm" (OuterVolumeSpecName: "dshm") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:34.626328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.626307    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk" (OuterVolumeSpecName: "kube-api-access-x9mxk") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "kube-api-access-x9mxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:34.626581 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.626553    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e24409cd-ab3b-4ad8-b6db-94882709b5bb" (UID: "e24409cd-ab3b-4ad8-b6db-94882709b5bb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:20:34.725350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725292    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:34.725350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725351    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x9mxk\" (UniqueName: \"kubernetes.io/projected/e24409cd-ab3b-4ad8-b6db-94882709b5bb-kube-api-access-x9mxk\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:34.725671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725371    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:34.725671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725386    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:34.725671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725399    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:34.725671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:34.725444    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e24409cd-ab3b-4ad8-b6db-94882709b5bb-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:35.165838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.165796    2580 generic.go:356] "Generic (PLEG): container finished" podID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" containerID="b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce" exitCode=0
Sep 08 00:20:35.166031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.165843    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"
Sep 08 00:20:35.166031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.165881    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" event={"ID":"e24409cd-ab3b-4ad8-b6db-94882709b5bb","Type":"ContainerDied","Data":"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"}
Sep 08 00:20:35.166031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.165924    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8" event={"ID":"e24409cd-ab3b-4ad8-b6db-94882709b5bb","Type":"ContainerDied","Data":"46bd71ba00205079adc4d75efd7b493eb5ab282ef61ae8fdfe8050d2e86ff904"}
Sep 08 00:20:35.166031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.165947    2580 scope.go:117] "RemoveContainer" containerID="b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"
Sep 08 00:20:35.176961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.176939    2580 scope.go:117] "RemoveContainer" containerID="b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"
Sep 08 00:20:35.177271 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:35.177250    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce\": container with ID starting with b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce not found: ID does not exist" containerID="b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"
Sep 08 00:20:35.177334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.177285    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce"} err="failed to get container status \"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce\": rpc error: code = NotFound desc = could not find container \"b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce\": container with ID starting with b004b1896644aeceb47740a1926bdba12a32b66050aba1f0ed983d049fb7b1ce not found: ID does not exist"
Sep 08 00:20:35.186355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.186324    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:20:35.190445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.190418    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-90b207/autores-model-90b207-kserve-579795899f-9l9m8"]
Sep 08 00:20:35.774951 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:35.774900    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" path="/var/lib/kubelet/pods/e24409cd-ab3b-4ad8-b6db-94882709b5bb/volumes"
Sep 08 00:20:36.245221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:36.245183    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:20:36.245475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:36.245408    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" containerID="cri-o://ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0" gracePeriod=30
Sep 08 00:20:37.007727 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.007690    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:20:37.008152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008110    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" containerName="payload-processing"
Sep 08 00:20:37.008152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008123    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" containerName="payload-processing"
Sep 08 00:20:37.008152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008139    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" containerName="main"
Sep 08 00:20:37.008152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008145    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" containerName="main"
Sep 08 00:20:37.008304 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008223    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24409cd-ab3b-4ad8-b6db-94882709b5bb" containerName="main"
Sep 08 00:20:37.008304 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.008232    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="59e3ce7e-5fec-40fc-9dae-9f7a37964794" containerName="payload-processing"
Sep 08 00:20:37.011531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.011507    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.013860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.013835    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-75e439-openshift-default-dockercfg-txl99\""
Sep 08 00:20:37.022325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.022294    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:20:37.151950 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.151910    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.151961    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.151988    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152054    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvfqf\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152117    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152143    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152238    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.152310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.152278    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.253809 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.253767    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.253980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.253824    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.253980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.253876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.253980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.253899    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.253980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.253921    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254130    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvfqf\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254167    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254572    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254584    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254759 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.254759 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.254669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.255037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.255013    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.256549 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.256531    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.256596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.256532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.261581 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.261512    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.261697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.261653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvfqf\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf\") pod \"e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") " pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.324771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.324729    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:37.607080 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.607047    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:20:37.608052 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:20:37.608024    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4ad6ac5_8ecf_4a73_8a06_58e5585bf020.slice/crio-48b090e0e33b4c91f59c594a59a456a65e5fd3e11e39d12a105323e11edeb53e WatchSource:0}: Error finding container 48b090e0e33b4c91f59c594a59a456a65e5fd3e11e39d12a105323e11edeb53e: Status 404 returned error can't find the container with id 48b090e0e33b4c91f59c594a59a456a65e5fd3e11e39d12a105323e11edeb53e
Sep 08 00:20:37.610438 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.610394    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:37.610536 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.610519    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:37.610591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:37.610573    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:38.189104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:38.188998    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerStarted","Data":"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"}
Sep 08 00:20:38.189104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:38.189061    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerStarted","Data":"48b090e0e33b4c91f59c594a59a456a65e5fd3e11e39d12a105323e11edeb53e"}
Sep 08 00:20:38.208368 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:38.208307    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podStartSLOduration=2.208290647 podStartE2EDuration="2.208290647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:20:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:20:38.206353704 +0000 UTC m=+1080.957050549" watchObservedRunningTime="2026-09-08 00:20:38.208290647 +0000 UTC m=+1080.958987490"
Sep 08 00:20:38.325636 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:38.325591    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:38.334149 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:38.334119    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:39.067514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.067475    2580 patch_prober.go:28] interesting pod/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:20:39.067694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.067541    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:20:39.195664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.195635    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:39.196703 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.196684    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:20:39.599012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.598967    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:39.599210 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.599031    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:39.611900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:39.611871    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:40.213384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:40.213347    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:20:41.508936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.508905    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:20:41.599185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599094    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9k87\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599197    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599308    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599326    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599341    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599373    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599409    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599436    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy\") pod \"485f7017-be4d-404a-8261-eb99780dc777\" (UID: \"485f7017-be4d-404a-8261-eb99780dc777\") "
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599576    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599612    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data" (OuterVolumeSpecName: "istio-data") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599888    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599907    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485f7017-be4d-404a-8261-eb99780dc777-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599920    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.599932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599932    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.600295 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.599944    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.601570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.601534    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87" (OuterVolumeSpecName: "kube-api-access-v9k87") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "kube-api-access-v9k87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:41.601570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.601545    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token" (OuterVolumeSpecName: "istio-token") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:20:41.601765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.601657    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:20:41.601765 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.601751    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "485f7017-be4d-404a-8261-eb99780dc777" (UID: "485f7017-be4d-404a-8261-eb99780dc777"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:20:41.692841 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.692801    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:20:41.700764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.700733    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485f7017-be4d-404a-8261-eb99780dc777-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.700764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.700759    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485f7017-be4d-404a-8261-eb99780dc777-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.700764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.700770    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9k87\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-kube-api-access-v9k87\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:41.700987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:41.700780    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485f7017-be4d-404a-8261-eb99780dc777-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:20:42.216373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.216341    2580 generic.go:356] "Generic (PLEG): container finished" podID="485f7017-be4d-404a-8261-eb99780dc777" containerID="ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0" exitCode=0
Sep 08 00:20:42.216576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.216406    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"
Sep 08 00:20:42.216576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.216425    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerDied","Data":"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"}
Sep 08 00:20:42.216576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.216495    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg" event={"ID":"485f7017-be4d-404a-8261-eb99780dc777","Type":"ContainerDied","Data":"932e4977ea8820e10c11c2a978e3320094ef144bcd03b7138669003de0320aae"}
Sep 08 00:20:42.216576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.216519    2580 scope.go:117] "RemoveContainer" containerID="ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"
Sep 08 00:20:42.226824 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.226779    2580 scope.go:117] "RemoveContainer" containerID="44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"
Sep 08 00:20:42.232928 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.232906    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:20:42.236742 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.236718    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-90b207-openshift-default-744dbf6fdb-xlwqg"]
Sep 08 00:20:42.238123 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.238108    2580 scope.go:117] "RemoveContainer" containerID="ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"
Sep 08 00:20:42.238406 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:42.238387    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0\": container with ID starting with ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0 not found: ID does not exist" containerID="ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"
Sep 08 00:20:42.238475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.238416    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0"} err="failed to get container status \"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0\": rpc error: code = NotFound desc = could not find container \"ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0\": container with ID starting with ab7740b2b7c534c9e1079a90cbc872fc7824cbf7204e4cd41568abf4bd0d35d0 not found: ID does not exist"
Sep 08 00:20:42.238475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.238435    2580 scope.go:117] "RemoveContainer" containerID="44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"
Sep 08 00:20:42.238723 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:20:42.238706    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5\": container with ID starting with 44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5 not found: ID does not exist" containerID="44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"
Sep 08 00:20:42.238763 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:42.238729    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5"} err="failed to get container status \"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5\": rpc error: code = NotFound desc = could not find container \"44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5\": container with ID starting with 44404b730252edd45731a9e7f4bca9f254462eddb221d74c714d4027dc7dddd5 not found: ID does not exist"
Sep 08 00:20:43.774673 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:43.774640    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="485f7017-be4d-404a-8261-eb99780dc777" path="/var/lib/kubelet/pods/485f7017-be4d-404a-8261-eb99780dc777/volumes"
Sep 08 00:20:58.334419 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.334384    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerID="ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa" exitCode=0
Sep 08 00:20:58.334854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.334412    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerDied","Data":"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"}
Sep 08 00:20:58.334854 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.334840    2580 scope.go:117] "RemoveContainer" containerID="ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"
Sep 08 00:20:58.336065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.336031    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:58.336173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.336120    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:58.336173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:58.336167    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:20:59.348496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:20:59.348439    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerStarted","Data":"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"}
Sep 08 00:21:00.325201 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:00.325157    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:00.325594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:00.325563    2580 patch_prober.go:28] interesting pod/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:21:00.325709 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:00.325632    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 08 00:21:01.325246 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:01.325202    2580 patch_prober.go:28] interesting pod/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:21:01.325818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:01.325276    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 08 00:21:01.482693 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:01.482649    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:21:02.325946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:02.325905    2580 patch_prober.go:28] interesting pod/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:21:02.326588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:02.326550    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 08 00:21:03.326016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:03.325978    2580 patch_prober.go:28] interesting pod/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:21:03.326642 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:03.326606    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 08 00:21:04.325380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:04.325339    2580 patch_prober.go:28] interesting pod/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Sep 08 00:21:04.325576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:04.325409    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Sep 08 00:21:05.329282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:05.329252    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:05.329700 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:05.329665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:05.330295 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:05.330279    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:17.483586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:17.483553    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:21:31.908818 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.908776    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"]
Sep 08 00:21:31.909431 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.909368    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:31.909431 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.909388    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:31.909599 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.909527    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:31.909599 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.909541    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:31.912800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.912778    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:31.914910 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.914883    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:21:31.915653 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.915635    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:21:31.918904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:31.918878    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"]
Sep 08 00:21:32.002220 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.002195    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-75e439-87pw5\" (UID: \"43f36217-1bad-4937-be3e-3de4c272f779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:32.103033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.103001    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-75e439-87pw5\" (UID: \"43f36217-1bad-4937-be3e-3de4c272f779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:32.103607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.103588    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-75e439-87pw5\" (UID: \"43f36217-1bad-4937-be3e-3de4c272f779\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:32.229877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.229852    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:32.503754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.503726    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"]
Sep 08 00:21:32.504495 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:21:32.504469    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f36217_1bad_4937_be3e_3de4c272f779.slice/crio-efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397 WatchSource:0}: Error finding container efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397: Status 404 returned error can't find the container with id efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397
Sep 08 00:21:32.578939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:32.578914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5" event={"ID":"43f36217-1bad-4937-be3e-3de4c272f779","Type":"ContainerStarted","Data":"efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397"}
Sep 08 00:21:33.590691 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:33.590608    2580 generic.go:356] "Generic (PLEG): container finished" podID="43f36217-1bad-4937-be3e-3de4c272f779" containerID="390e57988868fc2774565e3c51a0e9728eba9af1082a5c72cf95b547fc059e1b" exitCode=0
Sep 08 00:21:33.591030 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:33.590694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5" event={"ID":"43f36217-1bad-4937-be3e-3de4c272f779","Type":"ContainerDied","Data":"390e57988868fc2774565e3c51a0e9728eba9af1082a5c72cf95b547fc059e1b"}
Sep 08 00:21:33.870306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:33.870230    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:21:34.749024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:34.748999    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:34.825877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:34.825846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca\") pod \"43f36217-1bad-4937-be3e-3de4c272f779\" (UID: \"43f36217-1bad-4937-be3e-3de4c272f779\") "
Sep 08 00:21:34.826196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:34.826173    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43f36217-1bad-4937-be3e-3de4c272f779" (UID: "43f36217-1bad-4937-be3e-3de4c272f779"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:21:34.927378 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:34.927300    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43f36217-1bad-4937-be3e-3de4c272f779-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:35.443604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.443563    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:21:35.444084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.444063    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:35.444084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.444079    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="485f7017-be4d-404a-8261-eb99780dc777" containerName="istio-proxy"
Sep 08 00:21:35.444187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.444108    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43f36217-1bad-4937-be3e-3de4c272f779" containerName="revoke-keys"
Sep 08 00:21:35.444187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.444114    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="43f36217-1bad-4937-be3e-3de4c272f779" containerName="revoke-keys"
Sep 08 00:21:35.444187 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.444179    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="43f36217-1bad-4937-be3e-3de4c272f779" containerName="revoke-keys"
Sep 08 00:21:35.447442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.447421    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.449716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.449692    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-e250ebf1-openshift-default-dockercfg-drsk7\""
Sep 08 00:21:35.457557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.457532    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:21:35.534289 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534250    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534313    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534347    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlk69\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534428    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534488    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534535    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534581    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534626    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.534766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.534700    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.604707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.604680    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"
Sep 08 00:21:35.604870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.604710    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5" event={"ID":"43f36217-1bad-4937-be3e-3de4c272f779","Type":"ContainerDied","Data":"efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397"}
Sep 08 00:21:35.604870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.604758    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="efddf7cc4c5941149fcadccb28d7578b0a37f1207a9f0a26c3585675717a6397"
Sep 08 00:21:35.635685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635650    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.635830 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635709    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.635830 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635754    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.635830 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635801    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635867    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635911    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.635983    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlk69\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.636037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.636207    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.636269    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.636613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.636846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.636665    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.637253 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.637228    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.638521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.638498    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.639061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.639042    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.642923 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.642900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.643345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.643328    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlk69\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69\") pod \"e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") " pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:35.759439 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:35.759414    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:36.035912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.035884    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:21:36.037495 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:21:36.037466    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a9278c6_7eda_48af_a07d_f65df1aae096.slice/crio-9ea7a76839b02d1d8cb3b93ca3d9d20d1fc2edb3550797be93f2887cc0ec7a59 WatchSource:0}: Error finding container 9ea7a76839b02d1d8cb3b93ca3d9d20d1fc2edb3550797be93f2887cc0ec7a59: Status 404 returned error can't find the container with id 9ea7a76839b02d1d8cb3b93ca3d9d20d1fc2edb3550797be93f2887cc0ec7a59
Sep 08 00:21:36.039754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.039721    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:36.039842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.039787    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:36.039842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.039819    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:36.613365 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.613329    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerStarted","Data":"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"}
Sep 08 00:21:36.613571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.613389    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerStarted","Data":"9ea7a76839b02d1d8cb3b93ca3d9d20d1fc2edb3550797be93f2887cc0ec7a59"}
Sep 08 00:21:36.637846 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.637794    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podStartSLOduration=1.63777861 podStartE2EDuration="1.63777861s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:21:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:21:36.635235291 +0000 UTC m=+1139.385932149" watchObservedRunningTime="2026-09-08 00:21:36.63777861 +0000 UTC m=+1139.388475453"
Sep 08 00:21:36.760108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:36.760078    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:37.765848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:37.765813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:38.626612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:38.626579    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:38.627564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:38.627542    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:41.560823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.560794    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:21:41.671888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.671857    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"]
Sep 08 00:21:41.676933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.676911    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:41.679182 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.679156    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:21:41.679412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.679192    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:21:41.681697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.681619    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"]
Sep 08 00:21:41.691240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.691197    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2\" (UID: \"3f80acd5-2ef4-4bd9-9387-8df019ad27ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:41.792695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.792668    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2\" (UID: \"3f80acd5-2ef4-4bd9-9387-8df019ad27ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:41.793296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.793277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2\" (UID: \"3f80acd5-2ef4-4bd9-9387-8df019ad27ae\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:41.990131 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:41.990104    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:42.271842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.271808    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"]
Sep 08 00:21:42.272735 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:21:42.272708    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f80acd5_2ef4_4bd9_9387_8df019ad27ae.slice/crio-392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488 WatchSource:0}: Error finding container 392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488: Status 404 returned error can't find the container with id 392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488
Sep 08 00:21:42.508629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.508587    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"]
Sep 08 00:21:42.511619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.511595    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-75e439-87pw5"]
Sep 08 00:21:42.664281 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.664240    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2" event={"ID":"3f80acd5-2ef4-4bd9-9387-8df019ad27ae","Type":"ContainerStarted","Data":"5e9fb572b37b23967cc43519479c4edd65c2bd17f506ba886aa3716b4359201d"}
Sep 08 00:21:42.664684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.664327    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2" event={"ID":"3f80acd5-2ef4-4bd9-9387-8df019ad27ae","Type":"ContainerStarted","Data":"392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488"}
Sep 08 00:21:42.678692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:42.678643    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2" podStartSLOduration=1.6786292889999999 podStartE2EDuration="1.678629289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:21:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:21:42.677064563 +0000 UTC m=+1145.427761406" watchObservedRunningTime="2026-09-08 00:21:42.678629289 +0000 UTC m=+1145.429326132"
Sep 08 00:21:43.672841 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:43.672807    2580 generic.go:356] "Generic (PLEG): container finished" podID="3f80acd5-2ef4-4bd9-9387-8df019ad27ae" containerID="5e9fb572b37b23967cc43519479c4edd65c2bd17f506ba886aa3716b4359201d" exitCode=0
Sep 08 00:21:43.673220 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:43.672856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2" event={"ID":"3f80acd5-2ef4-4bd9-9387-8df019ad27ae","Type":"ContainerDied","Data":"5e9fb572b37b23967cc43519479c4edd65c2bd17f506ba886aa3716b4359201d"}
Sep 08 00:21:43.774279 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:43.774245    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43f36217-1bad-4937-be3e-3de4c272f779" path="/var/lib/kubelet/pods/43f36217-1bad-4937-be3e-3de4c272f779/volumes"
Sep 08 00:21:44.815892 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:44.815870    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:44.925302 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:44.925271    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca\") pod \"3f80acd5-2ef4-4bd9-9387-8df019ad27ae\" (UID: \"3f80acd5-2ef4-4bd9-9387-8df019ad27ae\") "
Sep 08 00:21:44.925632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:44.925611    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3f80acd5-2ef4-4bd9-9387-8df019ad27ae" (UID: "3f80acd5-2ef4-4bd9-9387-8df019ad27ae"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:21:45.026559 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:45.026533    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3f80acd5-2ef4-4bd9-9387-8df019ad27ae-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:45.688519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:45.688486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2" event={"ID":"3f80acd5-2ef4-4bd9-9387-8df019ad27ae","Type":"ContainerDied","Data":"392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488"}
Sep 08 00:21:45.688519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:45.688505    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"
Sep 08 00:21:45.688735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:45.688547    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="392fc565364adeb78a851edd9fd6c9b88cbe3d45e4e6d11c12c9e09c77050488"
Sep 08 00:21:52.282312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:52.282273    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"]
Sep 08 00:21:52.284823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:52.284802    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-4374d7-7cnk2"]
Sep 08 00:21:53.471664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:53.471629    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:21:53.777309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:53.777219    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f80acd5-2ef4-4bd9-9387-8df019ad27ae" path="/var/lib/kubelet/pods/3f80acd5-2ef4-4bd9-9387-8df019ad27ae/volumes"
Sep 08 00:21:53.918166 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:53.918132    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:21:53.918429 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:53.918397    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy" containerID="cri-o://266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83" gracePeriod=30
Sep 08 00:21:54.612772 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.612740    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:21:54.613362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.613344    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f80acd5-2ef4-4bd9-9387-8df019ad27ae" containerName="revoke-keys"
Sep 08 00:21:54.613362 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.613363    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f80acd5-2ef4-4bd9-9387-8df019ad27ae" containerName="revoke-keys"
Sep 08 00:21:54.613532 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.613485    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f80acd5-2ef4-4bd9-9387-8df019ad27ae" containerName="revoke-keys"
Sep 08 00:21:54.618055 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.618037    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.620106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.620086    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-12bd69-openshift-default-dockercfg-p7bsh\""
Sep 08 00:21:54.628094 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.628074    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:21:54.668588 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.668564    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:21:54.668710 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.668607    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726015    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726076    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726102    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726136    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726158    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726224    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92f4\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726254    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726305    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.726538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.726414    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.827996 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.827955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92f4\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828031    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828106    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828268    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828309    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828352    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828379    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828413    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.828663 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.828441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.829173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.829139    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.829307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.829218    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.829795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.829632    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.829918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.829558    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.829918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.829821    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.831938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.831911    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.832346 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.832327    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.836870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.836848    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92f4\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.836870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.836863    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token\") pod \"e2e-noten-12bd69-openshift-default-5757895868-b4t79\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") " pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:54.934354 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:54.934289    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:55.236479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.236429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:21:55.237627 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:21:55.237601    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5357e40a_2ded_4fc2_8428_6bcdc55a225e.slice/crio-0272e7adbb8e50e48d780b6f8ddeffaca5240601a8afe9829d231a76993323f3 WatchSource:0}: Error finding container 0272e7adbb8e50e48d780b6f8ddeffaca5240601a8afe9829d231a76993323f3: Status 404 returned error can't find the container with id 0272e7adbb8e50e48d780b6f8ddeffaca5240601a8afe9829d231a76993323f3
Sep 08 00:21:55.240703 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.240653    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.240789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.240764    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.240832 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.240818    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.763319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.763259    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerID="6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138" exitCode=0
Sep 08 00:21:55.763738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.763332    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerDied","Data":"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"}
Sep 08 00:21:55.763849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.763823    2580 scope.go:117] "RemoveContainer" containerID="6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"
Sep 08 00:21:55.765103 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.765066    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.765203 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.765162    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.765263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.765203    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:21:55.765343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.765322    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" event={"ID":"5357e40a-2ded-4fc2-8428-6bcdc55a225e","Type":"ContainerStarted","Data":"bc2004f52bc5a64e9de39f848c2f7aaa445c14787caef2dcf8926fd8613bee61"}
Sep 08 00:21:55.765401 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.765363    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" event={"ID":"5357e40a-2ded-4fc2-8428-6bcdc55a225e","Type":"ContainerStarted","Data":"0272e7adbb8e50e48d780b6f8ddeffaca5240601a8afe9829d231a76993323f3"}
Sep 08 00:21:55.805418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.804829    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" podStartSLOduration=1.80481069 podStartE2EDuration="1.80481069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:21:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:21:55.803129015 +0000 UTC m=+1158.553825871" watchObservedRunningTime="2026-09-08 00:21:55.80481069 +0000 UTC m=+1158.555507537"
Sep 08 00:21:55.935003 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:55.934906    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:56.580531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.580481    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" podUID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" containerName="main" containerID="cri-o://0eefa8a64f7e33b01b02e024e3de5e8577065ab4f890778c5a477e207f994ab8" gracePeriod=45
Sep 08 00:21:56.774422 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.774391    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerStarted","Data":"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"}
Sep 08 00:21:56.776826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.776800    2580 generic.go:356] "Generic (PLEG): container finished" podID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" containerID="0eefa8a64f7e33b01b02e024e3de5e8577065ab4f890778c5a477e207f994ab8" exitCode=0
Sep 08 00:21:56.776952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.776891    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" event={"ID":"6ce7999a-5bc9-40ac-9aed-d382264f37f2","Type":"ContainerDied","Data":"0eefa8a64f7e33b01b02e024e3de5e8577065ab4f890778c5a477e207f994ab8"}
Sep 08 00:21:56.882814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.882793    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.952721    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.952798    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.952838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.952899    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.952932    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.953003    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.953108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr5qm\" (UniqueName: \"kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm\") pod \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\" (UID: \"6ce7999a-5bc9-40ac-9aed-d382264f37f2\") "
Sep 08 00:21:56.953935 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.953725    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache" (OuterVolumeSpecName: "model-cache") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:56.954090 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.954071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:56.954273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.954243    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home" (OuterVolumeSpecName: "home") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:56.958142 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.958104    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm" (OuterVolumeSpecName: "dshm") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:56.958250 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.958162    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm" (OuterVolumeSpecName: "kube-api-access-cr5qm") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "kube-api-access-cr5qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:56.958432 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:56.958407    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6ce7999a-5bc9-40ac-9aed-d382264f37f2" (UID: "6ce7999a-5bc9-40ac-9aed-d382264f37f2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:21:57.054755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054722    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.054755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054749    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr5qm\" (UniqueName: \"kubernetes.io/projected/6ce7999a-5bc9-40ac-9aed-d382264f37f2-kube-api-access-cr5qm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.054755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054759    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.055002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054768    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.055002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054776    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.055002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.054783    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6ce7999a-5bc9-40ac-9aed-d382264f37f2-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:57.759915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.759879    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:21:57.760112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.760075    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 00:21:57.760192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.760132    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 00:21:57.784712 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.784692    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"
Sep 08 00:21:57.785040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.784728    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77" event={"ID":"6ce7999a-5bc9-40ac-9aed-d382264f37f2","Type":"ContainerDied","Data":"a9b884b2b3f1e6544ed25e00a762d30224de453251e730e764f1e2552cc6aaa9"}
Sep 08 00:21:57.785040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.784769    2580 scope.go:117] "RemoveContainer" containerID="0eefa8a64f7e33b01b02e024e3de5e8577065ab4f890778c5a477e207f994ab8"
Sep 08 00:21:57.785384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.785361    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:57.786217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.786065    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:21:57.829472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.822520    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:21:57.832671 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:57.830757    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-c4541b/test-model-c4541b-kserve-65cc8d867f-hfr77"]
Sep 08 00:21:58.644476 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:58.636567    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:21:58.644476 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:58.636814    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" containerID="cri-o://ae2d1c20422a502e6a3b0bed01f90876edc7b00818e84e9b9aa776d6c00dcdca" gracePeriod=30
Sep 08 00:21:58.760474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:58.759842    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 00:21:58.760474 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:58.759905    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 00:21:59.239472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.238640    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:59.377915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.377884    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dvfqf\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.377915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.377919    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.377970    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378049    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378154    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378178    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378239    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert\") pod \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\" (UID: \"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020\") "
Sep 08 00:21:59.378366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378317    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:59.378366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378353    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:59.378581 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378542    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data" (OuterVolumeSpecName: "istio-data") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:59.378644 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378626    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:59.378707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378649    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:21:59.378707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378688    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.378707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378701    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.378865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.378710    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.380259 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.380226    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token" (OuterVolumeSpecName: "istio-token") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:59.380259 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.380251    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:21:59.380547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.380525    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf" (OuterVolumeSpecName: "kube-api-access-dvfqf") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "kube-api-access-dvfqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:21:59.380695 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.380676    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" (UID: "e4ad6ac5-8ecf-4a73-8a06-58e5585bf020"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:21:59.395160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.395124    2580 patch_prober.go:28] interesting pod/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:21:59.395268 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.395188    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:21:59.479638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479614    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.479638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479637    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.479805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479647    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvfqf\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-kube-api-access-dvfqf\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.479805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479656    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.479805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479663    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.479805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.479671    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:21:59.760372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.760289    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 00:21:59.760372 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.760343    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 00:21:59.780965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.780932    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" path="/var/lib/kubelet/pods/6ce7999a-5bc9-40ac-9aed-d382264f37f2/volumes"
Sep 08 00:21:59.800492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.800442    2580 generic.go:356] "Generic (PLEG): container finished" podID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerID="266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83" exitCode=0
Sep 08 00:21:59.800492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.800480    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerDied","Data":"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"}
Sep 08 00:21:59.800685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.800523    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"
Sep 08 00:21:59.800685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.800545    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb" event={"ID":"e4ad6ac5-8ecf-4a73-8a06-58e5585bf020","Type":"ContainerDied","Data":"48b090e0e33b4c91f59c594a59a456a65e5fd3e11e39d12a105323e11edeb53e"}
Sep 08 00:21:59.800685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.800591    2580 scope.go:117] "RemoveContainer" containerID="266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"
Sep 08 00:21:59.810254 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.810238    2580 scope.go:117] "RemoveContainer" containerID="ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"
Sep 08 00:21:59.818127 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.818105    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:21:59.820529 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.820513    2580 scope.go:117] "RemoveContainer" containerID="266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"
Sep 08 00:21:59.820804 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:21:59.820784    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83\": container with ID starting with 266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83 not found: ID does not exist" containerID="266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"
Sep 08 00:21:59.820851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.820812    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83"} err="failed to get container status \"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83\": rpc error: code = NotFound desc = could not find container \"266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83\": container with ID starting with 266759c141f5392a27477c3b177953008cc556905257f0d281ea9384cf958d83 not found: ID does not exist"
Sep 08 00:21:59.820851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.820827    2580 scope.go:117] "RemoveContainer" containerID="ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"
Sep 08 00:21:59.821092 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:21:59.821075    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa\": container with ID starting with ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa not found: ID does not exist" containerID="ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"
Sep 08 00:21:59.821136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.821098    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa"} err="failed to get container status \"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa\": rpc error: code = NotFound desc = could not find container \"ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa\": container with ID starting with ef65ccf2e68db791b976bf012ccb18aaab1341b74e7bcf2c7455385f393e76aa not found: ID does not exist"
Sep 08 00:21:59.846473 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:21:59.821752    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-75e439-openshift-default-c77644cdd-jhjbb"]
Sep 08 00:22:00.760608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:00.760572    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 00:22:00.760996 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:00.760629    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 00:22:01.759811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:01.759773    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 08 00:22:01.760014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:01.759824    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 08 00:22:01.775020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:01.774981    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" path="/var/lib/kubelet/pods/e4ad6ac5-8ecf-4a73-8a06-58e5585bf020/volumes"
Sep 08 00:22:02.764066 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:02.764032    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:22:02.764464 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:02.764436    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:22:02.765072 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:02.765047    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:22:03.835552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:03.835523    2580 generic.go:356] "Generic (PLEG): container finished" podID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerID="ae2d1c20422a502e6a3b0bed01f90876edc7b00818e84e9b9aa776d6c00dcdca" exitCode=0
Sep 08 00:22:03.835936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:03.835601    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerDied","Data":"ae2d1c20422a502e6a3b0bed01f90876edc7b00818e84e9b9aa776d6c00dcdca"}
Sep 08 00:22:03.835936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:03.835676    2580 scope.go:117] "RemoveContainer" containerID="287fe7abff594d9dc287c8eff53d26408c6280892fdf99c1b5db2e80b834d248"
Sep 08 00:22:03.903345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:03.903326    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:22:04.019902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.019879    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.019917    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4z9k\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.019946    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.019980    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020005    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020061 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020052    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020113    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020142    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020166    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket\") pod \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\" (UID: \"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7\") "
Sep 08 00:22:04.020334 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020164    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data" (OuterVolumeSpecName: "istio-data") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:04.020571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020364    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:04.020571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020422    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:04.020571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020477    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:04.020733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020574    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.020733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020591    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.020733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020602    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.020733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020611    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.020733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.020630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:04.022428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.022380    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k" (OuterVolumeSpecName: "kube-api-access-q4z9k") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "kube-api-access-q4z9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:04.022428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.022383    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:22:04.022613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.022476    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token" (OuterVolumeSpecName: "istio-token") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:04.022613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.022484    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" (UID: "dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:04.121650 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.121625    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.121737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.121651    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.121737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.121665    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4z9k\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-kube-api-access-q4z9k\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.121737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.121677    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.121737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.121691    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:04.843688 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.843652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd" event={"ID":"dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7","Type":"ContainerDied","Data":"4aac1211992d98087a689539432cb6341fd1348de0cb740a1c5d6a219f34237a"}
Sep 08 00:22:04.844154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.843704    2580 scope.go:117] "RemoveContainer" containerID="ae2d1c20422a502e6a3b0bed01f90876edc7b00818e84e9b9aa776d6c00dcdca"
Sep 08 00:22:04.844154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.843660    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"
Sep 08 00:22:04.864931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.864910    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:22:04.869043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:04.869020    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-4374d7-openshift-default-76f5cb856-q2gtd"]
Sep 08 00:22:05.774009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:05.773974    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" path="/var/lib/kubelet/pods/dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7/volumes"
Sep 08 00:22:06.780834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:06.780806    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:22:08.772156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:08.772119    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:22:08.772622 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:08.772350    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerName="istio-proxy" containerID="cri-o://bc2004f52bc5a64e9de39f848c2f7aaa445c14787caef2dcf8926fd8613bee61" gracePeriod=30
Sep 08 00:22:12.787677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:12.787640    2580 patch_prober.go:28] interesting pod/e2e-noten-12bd69-openshift-default-5757895868-b4t79 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:22:12.788055 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:12.787710    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:22:13.907629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:13.907600    2580 generic.go:356] "Generic (PLEG): container finished" podID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerID="bc2004f52bc5a64e9de39f848c2f7aaa445c14787caef2dcf8926fd8613bee61" exitCode=0
Sep 08 00:22:13.907971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:13.907673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" event={"ID":"5357e40a-2ded-4fc2-8428-6bcdc55a225e","Type":"ContainerDied","Data":"bc2004f52bc5a64e9de39f848c2f7aaa445c14787caef2dcf8926fd8613bee61"}
Sep 08 00:22:14.020875 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.020853    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:22:14.116639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116570    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s92f4\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116663    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116692    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116714    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116740    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116794    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116820    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116846    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.116978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.116899    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert\") pod \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\" (UID: \"5357e40a-2ded-4fc2-8428-6bcdc55a225e\") "
Sep 08 00:22:14.117178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:14.117178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117041    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:14.117291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117267    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data" (OuterVolumeSpecName: "istio-data") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:14.117291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117279    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:14.117396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117340    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:14.117396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117284    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.117396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.117391    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.118907 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.118883    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:22:14.119031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.118907    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4" (OuterVolumeSpecName: "kube-api-access-s92f4") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "kube-api-access-s92f4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:14.119031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.119003    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token" (OuterVolumeSpecName: "istio-token") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:14.119208 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.119190    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5357e40a-2ded-4fc2-8428-6bcdc55a225e" (UID: "5357e40a-2ded-4fc2-8428-6bcdc55a225e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:14.218806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218778    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218806    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218817    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218825    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218833    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218841    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5357e40a-2ded-4fc2-8428-6bcdc55a225e-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.218937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.218848    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s92f4\" (UniqueName: \"kubernetes.io/projected/5357e40a-2ded-4fc2-8428-6bcdc55a225e-kube-api-access-s92f4\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:14.915010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.914978    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"
Sep 08 00:22:14.915423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.915006    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79" event={"ID":"5357e40a-2ded-4fc2-8428-6bcdc55a225e","Type":"ContainerDied","Data":"0272e7adbb8e50e48d780b6f8ddeffaca5240601a8afe9829d231a76993323f3"}
Sep 08 00:22:14.915423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.915067    2580 scope.go:117] "RemoveContainer" containerID="bc2004f52bc5a64e9de39f848c2f7aaa445c14787caef2dcf8926fd8613bee61"
Sep 08 00:22:14.936489 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.936462    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:22:14.940858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:14.940838    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-12bd69-openshift-default-5757895868-b4t79"]
Sep 08 00:22:15.773529 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:15.773496    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" path="/var/lib/kubelet/pods/5357e40a-2ded-4fc2-8428-6bcdc55a225e/volumes"
Sep 08 00:22:16.289049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:16.289019    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:22:16.289408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:16.289285    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy" containerID="cri-o://71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72" gracePeriod=30
Sep 08 00:22:16.777696 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:16.777659    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:22:17.083596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.083523    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:22:17.084050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084035    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerName="istio-proxy"
Sep 08 00:22:17.084091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084054    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerName="istio-proxy"
Sep 08 00:22:17.084091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084065    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:17.084091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084070    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:17.084091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084080    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" containerName="main"
Sep 08 00:22:17.084091 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084086    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" containerName="main"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084095    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084101    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084115    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084121    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084128    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084133    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084214    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084222    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084230    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ce7999a-5bc9-40ac-9aed-d382264f37f2" containerName="main"
Sep 08 00:22:17.084247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.084241    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="5357e40a-2ded-4fc2-8428-6bcdc55a225e" containerName="istio-proxy"
Sep 08 00:22:17.089089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.089064    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.091239 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.091216    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-8978e7-openshift-default-dockercfg-fp5wz\""
Sep 08 00:22:17.095764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.095744    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:22:17.244652 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244619    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.244838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244669    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.244838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244724    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.244838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244747    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnmt8\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.244838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244807    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.245069 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244881    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.245069 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.244940    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.245069 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.245007    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.245195 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.245071    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.345881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.345821    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.345881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.345864    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.345881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.345888    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.345922    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.345955    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346008    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346032    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnmt8\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346065    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346278    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346343    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346383    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346541    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.346817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.346778    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.348358 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.348330    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.348597 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.348578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.353175 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.353153    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.353272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.353215    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnmt8\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8\") pod \"e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") " pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.401223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.401203    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:17.677112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.677083    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:22:17.677465 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:22:17.677420    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6925befe_8934_46e1_b5c9_09dda62fb577.slice/crio-07e1ae2e669f2dab9472295e861d97e12f90c03212285d33d0e2bf47446c3bf7 WatchSource:0}: Error finding container 07e1ae2e669f2dab9472295e861d97e12f90c03212285d33d0e2bf47446c3bf7: Status 404 returned error can't find the container with id 07e1ae2e669f2dab9472295e861d97e12f90c03212285d33d0e2bf47446c3bf7
Sep 08 00:22:17.680172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.680141    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:17.680248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.680204    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:17.680248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.680240    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:17.939192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.939093    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerStarted","Data":"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"}
Sep 08 00:22:17.939192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.939161    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerStarted","Data":"07e1ae2e669f2dab9472295e861d97e12f90c03212285d33d0e2bf47446c3bf7"}
Sep 08 00:22:17.958587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:17.958539    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podStartSLOduration=0.958525005 podStartE2EDuration="958.525005ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:17.95623252 +0000 UTC m=+1180.706929364" watchObservedRunningTime="2026-09-08 00:22:17.958525005 +0000 UTC m=+1180.709221848"
Sep 08 00:22:18.402079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:18.402041    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:18.407256 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:18.407231    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:18.945876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:18.945847    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:18.946903 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:18.946883    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:21.549548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.549522    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:22:21.585209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585141    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585216    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585243    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585304    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585327    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pwglq\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585406    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585416    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:21.585625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585470    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585496    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket\") pod \"cfb54234-9492-42aa-b16b-00cddea90b4a\" (UID: \"cfb54234-9492-42aa-b16b-00cddea90b4a\") "
Sep 08 00:22:21.585819 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585630    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:21.585819 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585700    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:21.585931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585822    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cfb54234-9492-42aa-b16b-00cddea90b4a-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.585931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585827    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data" (OuterVolumeSpecName: "istio-data") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:21.585931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585839    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.585931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.585853    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.586145 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.586070    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:21.587944 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.587920    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:21.587944 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.587933    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token" (OuterVolumeSpecName: "istio-token") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:21.588213 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.588191    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq" (OuterVolumeSpecName: "kube-api-access-pwglq") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "kube-api-access-pwglq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:21.588213 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.588204    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cfb54234-9492-42aa-b16b-00cddea90b4a" (UID: "cfb54234-9492-42aa-b16b-00cddea90b4a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:22:21.687136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687110    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.687136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687136    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.687303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687148    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.687303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687160    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.687303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687171    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.687303 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.687183    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pwglq\" (UniqueName: \"kubernetes.io/projected/cfb54234-9492-42aa-b16b-00cddea90b4a-kube-api-access-pwglq\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:21.968317 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.968281    2580 generic.go:356] "Generic (PLEG): container finished" podID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerID="71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72" exitCode=0
Sep 08 00:22:21.968527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.968325    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"
Sep 08 00:22:21.968527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.968364    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerDied","Data":"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"}
Sep 08 00:22:21.968527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.968429    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c" event={"ID":"cfb54234-9492-42aa-b16b-00cddea90b4a","Type":"ContainerDied","Data":"263028513a4baa4404b14a02e6149537bb9766989461d0eaf29528f277a16c95"}
Sep 08 00:22:21.968527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.968488    2580 scope.go:117] "RemoveContainer" containerID="71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"
Sep 08 00:22:21.977874 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.977857    2580 scope.go:117] "RemoveContainer" containerID="4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"
Sep 08 00:22:21.986288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.986210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:22:21.986341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.986312    2580 scope.go:117] "RemoveContainer" containerID="71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"
Sep 08 00:22:21.986674 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:22:21.986653    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72\": container with ID starting with 71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72 not found: ID does not exist" containerID="71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"
Sep 08 00:22:21.986748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.986681    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72"} err="failed to get container status \"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72\": rpc error: code = NotFound desc = could not find container \"71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72\": container with ID starting with 71f3382ffa53075c2df00ec789da42088ba5cc0e64d12d82ffd5694e241dbe72 not found: ID does not exist"
Sep 08 00:22:21.986748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.986699    2580 scope.go:117] "RemoveContainer" containerID="4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"
Sep 08 00:22:21.987260 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:22:21.987034    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6\": container with ID starting with 4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6 not found: ID does not exist" containerID="4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"
Sep 08 00:22:21.987260 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.987065    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6"} err="failed to get container status \"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6\": rpc error: code = NotFound desc = could not find container \"4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6\": container with ID starting with 4c9ee6463a6952f2df7ffda167bde82ab71323f2b436ac38e528e3570167c3c6 not found: ID does not exist"
Sep 08 00:22:21.990169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:21.990151    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-c4541b-openshift-default-5655945b74-njq5c"]
Sep 08 00:22:23.774218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:23.774182    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" path="/var/lib/kubelet/pods/cfb54234-9492-42aa-b16b-00cddea90b4a/volumes"
Sep 08 00:22:24.577617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:24.577578    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:22:28.203272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:28.203239    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:22:28.203747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:28.203475    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" containerID="cri-o://80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a" gracePeriod=30
Sep 08 00:22:32.766249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:32.766210    2580 patch_prober.go:28] interesting pod/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:22:32.766744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:32.766270    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:22:33.462607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.462581    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:22:33.503946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.503853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.503943    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.503983    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504024    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlk69\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504132    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504164    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504217    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert\") pod \"8a9278c6-7eda-48af-a07d-f65df1aae096\" (UID: \"8a9278c6-7eda-48af-a07d-f65df1aae096\") "
Sep 08 00:22:33.504538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504254    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data" (OuterVolumeSpecName: "istio-data") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:33.504538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504334    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:33.504761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504575    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.504761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504593    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.504761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504745    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:33.504934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504770    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:33.504934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.504805    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:22:33.506438 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.506408    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:22:33.506438 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.506436    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:22:33.506693 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.506662    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69" (OuterVolumeSpecName: "kube-api-access-wlk69") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "kube-api-access-wlk69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:33.506820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.506792    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token" (OuterVolumeSpecName: "istio-token") pod "8a9278c6-7eda-48af-a07d-f65df1aae096" (UID: "8a9278c6-7eda-48af-a07d-f65df1aae096"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:22:33.605767 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605734    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605767 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605764    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605776    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlk69\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-kube-api-access-wlk69\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605785    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605793    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a9278c6-7eda-48af-a07d-f65df1aae096-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605801    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a9278c6-7eda-48af-a07d-f65df1aae096-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:33.605962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:33.605810    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a9278c6-7eda-48af-a07d-f65df1aae096-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:22:34.052570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.052447    2580 generic.go:356] "Generic (PLEG): container finished" podID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerID="80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a" exitCode=0
Sep 08 00:22:34.052570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.052545    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"
Sep 08 00:22:34.053039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.052486    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerDied","Data":"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"}
Sep 08 00:22:34.053039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.052636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr" event={"ID":"8a9278c6-7eda-48af-a07d-f65df1aae096","Type":"ContainerDied","Data":"9ea7a76839b02d1d8cb3b93ca3d9d20d1fc2edb3550797be93f2887cc0ec7a59"}
Sep 08 00:22:34.053039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.052668    2580 scope.go:117] "RemoveContainer" containerID="80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"
Sep 08 00:22:34.062099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.062071    2580 scope.go:117] "RemoveContainer" containerID="6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"
Sep 08 00:22:34.069015 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.068990    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:22:34.071352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.071330    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-e250ebf1-openshift-default-6b5c78b8d8-qzmfr"]
Sep 08 00:22:34.071612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.071600    2580 scope.go:117] "RemoveContainer" containerID="80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"
Sep 08 00:22:34.071905 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:22:34.071885    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a\": container with ID starting with 80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a not found: ID does not exist" containerID="80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"
Sep 08 00:22:34.071953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.071913    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a"} err="failed to get container status \"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a\": rpc error: code = NotFound desc = could not find container \"80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a\": container with ID starting with 80517dd3a6c7aa9a9d1e9e53a4c4146a79076de10ae01cc0617bcdf4cab6bf6a not found: ID does not exist"
Sep 08 00:22:34.071953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.071930    2580 scope.go:117] "RemoveContainer" containerID="6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"
Sep 08 00:22:34.072179 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:22:34.072162    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138\": container with ID starting with 6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138 not found: ID does not exist" containerID="6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"
Sep 08 00:22:34.072235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:34.072188    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138"} err="failed to get container status \"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138\": rpc error: code = NotFound desc = could not find container \"6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138\": container with ID starting with 6363b9bdc09a5ed26187d80c68d93648e0b29642877e182f936807ba0d478138 not found: ID does not exist"
Sep 08 00:22:35.773795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:35.773762    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" path="/var/lib/kubelet/pods/8a9278c6-7eda-48af-a07d-f65df1aae096/volumes"
Sep 08 00:22:37.854652 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:37.854625    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:22:37.859975 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:37.859950    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:22:41.753367 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753320    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:22:41.753941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753911    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.753941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753936    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753948    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753957    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753975    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.753984    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754006    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.754075 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754014    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.754391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754105    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfc1bd86-f9c2-4678-a3a0-8c60d4a6cfa7" containerName="istio-proxy"
Sep 08 00:22:41.754391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754118    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4ad6ac5-8ecf-4a73-8a06-58e5585bf020" containerName="istio-proxy"
Sep 08 00:22:41.754391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754128    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:41.754391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754141    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.754391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.754150    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a9278c6-7eda-48af-a07d-f65df1aae096" containerName="istio-proxy"
Sep 08 00:22:41.761985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.761956    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.765311 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.765281    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c6a703-openshift-default-dockercfg-smdnf\""
Sep 08 00:22:41.779442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.779406    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:22:41.884657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884598    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884662    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fthh\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884769    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884795    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884823    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884901    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.884930 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884917    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.885178 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.884945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986154    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986216    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986241    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986289    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986313    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986344    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986411    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fthh\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986669    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986844 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986809    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986852    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.986984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.986965    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.987336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.987315    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.988659 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.988637    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.989323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.989301    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.993312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.993284    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:41.993493 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:41.993440    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fthh\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh\") pod \"e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") " pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:42.081223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:42.081133    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:42.362139 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:42.362116    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:22:42.363356 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:22:42.363332    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c90888_4f7d_4b9a_84a9_63bbae312b15.slice/crio-61bd2a2afa493f8c83f2572241287aeb310a199fa7d018d95744ea1e477799b4 WatchSource:0}: Error finding container 61bd2a2afa493f8c83f2572241287aeb310a199fa7d018d95744ea1e477799b4: Status 404 returned error can't find the container with id 61bd2a2afa493f8c83f2572241287aeb310a199fa7d018d95744ea1e477799b4
Sep 08 00:22:42.365506 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:42.365474    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:42.365578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:42.365539    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:42.365578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:42.365569    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:43.111385 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.111346    2580 generic.go:356] "Generic (PLEG): container finished" podID="6925befe-8934-46e1-b5c9-09dda62fb577" containerID="c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0" exitCode=0
Sep 08 00:22:43.111794 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.111410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerDied","Data":"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"}
Sep 08 00:22:43.111876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.111855    2580 scope.go:117] "RemoveContainer" containerID="c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"
Sep 08 00:22:43.112938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.112908    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:43.113039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.112992    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:43.113107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.113043    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:43.113249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.113230    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerStarted","Data":"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"}
Sep 08 00:22:43.113316 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.113278    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerStarted","Data":"61bd2a2afa493f8c83f2572241287aeb310a199fa7d018d95744ea1e477799b4"}
Sep 08 00:22:43.145658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:43.145596    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podStartSLOduration=2.145576585 podStartE2EDuration="2.145576585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:43.145415085 +0000 UTC m=+1205.896111930" watchObservedRunningTime="2026-09-08 00:22:43.145576585 +0000 UTC m=+1205.896273430"
Sep 08 00:22:44.082053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.082019    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:44.087125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.087101    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:44.121098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.121070    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerStarted","Data":"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"}
Sep 08 00:22:44.121538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.121523    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:44.129988 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.129912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:22:44.402169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.402089    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:44.403213 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.403182    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:44.403342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:44.403230    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:45.385852 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.385821    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:22:45.386526 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.386508    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfb54234-9492-42aa-b16b-00cddea90b4a" containerName="istio-proxy"
Sep 08 00:22:45.390139 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.390120    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.393336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.393317    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-b8c8cd-openshift-default-dockercfg-xx49b\""
Sep 08 00:22:45.401759 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.401737    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:22:45.402008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.401980    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:45.402112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.402032    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:45.517461 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517536    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517622    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517680    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517719    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517757    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f6hk\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517787    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.517859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.517820    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.618986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.618949    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.618998    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619023    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619052    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f6hk\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619073    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619092    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619175    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619204    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619235    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619621 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619578    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619722 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619659    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619832    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619841    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.619987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.619854    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.628472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.621640    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.628472 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.621915    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.629101 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.629081    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.629270 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.629147    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f6hk\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk\") pod \"e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") " pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:45.703050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:45.702973    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:46.017332 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.017300    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:22:46.017863 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:22:46.017835    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe760a6_f66d_4a13_9dce_d69221a320e7.slice/crio-4de96801e748be80a3ddd0c90ace16f8b7ad2685323e4d03b0646dc0369ead46 WatchSource:0}: Error finding container 4de96801e748be80a3ddd0c90ace16f8b7ad2685323e4d03b0646dc0369ead46: Status 404 returned error can't find the container with id 4de96801e748be80a3ddd0c90ace16f8b7ad2685323e4d03b0646dc0369ead46
Sep 08 00:22:46.020089 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.020056    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:46.020165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.020121    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:46.020165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.020148    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:22:46.152267 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.152222    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerStarted","Data":"422d4118f0d081a8d4f1ab3ca8fcffd19bed65c550ea13a8a3220e8824fe9806"}
Sep 08 00:22:46.152443 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.152288    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerStarted","Data":"4de96801e748be80a3ddd0c90ace16f8b7ad2685323e4d03b0646dc0369ead46"}
Sep 08 00:22:46.172596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.172537    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podStartSLOduration=1.172517868 podStartE2EDuration="1.172517868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:22:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:22:46.168003376 +0000 UTC m=+1208.918700221" watchObservedRunningTime="2026-09-08 00:22:46.172517868 +0000 UTC m=+1208.923214714"
Sep 08 00:22:46.401932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.401839    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:46.401932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.401898    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:46.704024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:46.703939    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:47.402092 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:47.402054    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:47.402540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:47.402111    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:47.708625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:47.708538    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:48.166802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:48.166769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:48.168024 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:48.167999    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:22:48.402402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:48.402364    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:48.402912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:48.402424    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:48.946407 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:48.946368    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:49.402189 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:49.402151    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused" start-of-body=
Sep 08 00:22:49.402347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:49.402215    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.77:15021/healthz/ready\": dial tcp 10.132.0.77:15021: connect: connection refused"
Sep 08 00:22:50.406132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:50.406101    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:50.407180 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:50.407159    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:22:53.177128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:22:53.177098    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:23:03.167962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.167901    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:03.168306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.167964    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:03.272707 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.272683    2580 generic.go:356] "Generic (PLEG): container finished" podID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerID="422d4118f0d081a8d4f1ab3ca8fcffd19bed65c550ea13a8a3220e8824fe9806" exitCode=0
Sep 08 00:23:03.272823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.272763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerDied","Data":"422d4118f0d081a8d4f1ab3ca8fcffd19bed65c550ea13a8a3220e8824fe9806"}
Sep 08 00:23:03.273212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.273188    2580 scope.go:117] "RemoveContainer" containerID="422d4118f0d081a8d4f1ab3ca8fcffd19bed65c550ea13a8a3220e8824fe9806"
Sep 08 00:23:03.274337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274306    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:03.274408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274377    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:03.274408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274395    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerID="584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579" exitCode=0
Sep 08 00:23:03.274510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274408    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:03.274510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274483    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerDied","Data":"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"}
Sep 08 00:23:03.274832 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.274817    2580 scope.go:117] "RemoveContainer" containerID="584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"
Sep 08 00:23:03.275810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.275787    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:03.275865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.275847    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:03.275916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:03.275903    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:04.285162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:04.285122    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerStarted","Data":"b18549692a91a293777fec2cd4010f9444e98cc8ca0dcda36a07996a23cb7ca5"}
Sep 08 00:23:04.287018 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:04.286997    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerStarted","Data":"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"}
Sep 08 00:23:04.703368 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:04.703284    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:23:04.703563 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:04.703384    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:04.703563 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:04.703418    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:05.081637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:05.081593    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:23:05.081839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:05.081775    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 08 00:23:05.081839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:05.081818    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 08 00:23:05.703561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:05.703525    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:05.703995 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:05.703579    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:06.081543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:06.081505    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 08 00:23:06.081748 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:06.081568    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 08 00:23:06.703487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:06.703431    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:06.703660 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:06.703503    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:07.082316 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:07.082281    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 08 00:23:07.082521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:07.082361    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 08 00:23:07.703738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:07.703695    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:07.704173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:07.703771    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:08.082026 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:08.081984    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 08 00:23:08.082209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:08.082038    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 08 00:23:08.703601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:08.703566    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:08.703777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:08.703624    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:09.082145 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:09.082103    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Sep 08 00:23:09.082358 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:09.082168    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Sep 08 00:23:09.703747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:09.703701    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused" start-of-body=
Sep 08 00:23:09.703943 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:09.703777    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.79:15021/healthz/ready\": dial tcp 10.132.0.79:15021: connect: connection refused"
Sep 08 00:23:10.085780 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.085749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:23:10.086079 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.086054    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:23:10.086670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.086652    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:23:10.593275 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.593242    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:23:10.596879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.596856    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.599141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.599112    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-e1e91c-openshift-default-dockercfg-w7w9d\""
Sep 08 00:23:10.610025 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.610003    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:23:10.704405 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704374    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704411    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfgdm\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704530    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704645    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704682    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704756    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.704835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.704822    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.708493 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.708470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:23:10.708923 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.708908    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:23:10.709505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.709487    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:23:10.805499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805468    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805500    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805620    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805672    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805734    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805760    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805829    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.805909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805895    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806059 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.805919    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfgdm\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806059 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.806028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.806097    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.806152    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.806230    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.806272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.806240    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.808082 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.808056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.808190 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.808159    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.814750 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.814727    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.815475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.815441    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfgdm\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm\") pod \"e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") " pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:10.907788 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:10.907685    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:11.188970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.188942    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:23:11.189854 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:11.189828    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db76cc8_36b6_48cb_931a_d2e6e3a58dca.slice/crio-4532a0e17e5dc1a538167d29262e7112e181555e081ae9910b6177028db2efe7 WatchSource:0}: Error finding container 4532a0e17e5dc1a538167d29262e7112e181555e081ae9910b6177028db2efe7: Status 404 returned error can't find the container with id 4532a0e17e5dc1a538167d29262e7112e181555e081ae9910b6177028db2efe7
Sep 08 00:23:11.192234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.192202    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:11.192324 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.192263    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:11.192324 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.192292    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:11.342530 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.342415    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerStarted","Data":"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"}
Sep 08 00:23:11.342530 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.342492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerStarted","Data":"4532a0e17e5dc1a538167d29262e7112e181555e081ae9910b6177028db2efe7"}
Sep 08 00:23:11.363426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.363369    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podStartSLOduration=1.363351761 podStartE2EDuration="1.363351761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:11.359980712 +0000 UTC m=+1234.110677594" watchObservedRunningTime="2026-09-08 00:23:11.363351761 +0000 UTC m=+1234.114048605"
Sep 08 00:23:11.908168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:11.908138    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:12.913864 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:12.913836    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:13.355031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:13.354997    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:13.356000 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:13.355977    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:20.578750 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:20.578711    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:23:29.396609 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:29.396568    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:23:29.396961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:29.396645    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:23:31.486360 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.486326    2580 generic.go:356] "Generic (PLEG): container finished" podID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerID="acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea" exitCode=0
Sep 08 00:23:31.486829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.486399    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerDied","Data":"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"}
Sep 08 00:23:31.486829 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.486826    2580 scope.go:117] "RemoveContainer" containerID="acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"
Sep 08 00:23:31.487901 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.487871    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:31.487990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.487936    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:31.487990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:31.487968    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:32.495132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:32.495100    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerStarted","Data":"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"}
Sep 08 00:23:32.908149 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:32.908072    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:32.908342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:32.908199    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:32.908342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:32.908236    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:33.908637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:33.908605    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:33.909039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:33.908672    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:34.908616 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:34.908583    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:34.908863 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:34.908635    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:35.908982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:35.908946    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:35.909389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:35.909004    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:36.908871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:36.908839    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:36.909057 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:36.908889    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:37.284817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.284786    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:23:37.288501 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.288479    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.291423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.291390    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"kube-root-ca.crt\""
Sep 08 00:23:37.291423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.291391    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"auth-test-model-8978e7-kserve-self-signed-certs\""
Sep 08 00:23:37.291625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.291401    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"openshift-service-ca.crt\""
Sep 08 00:23:37.291625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.291443    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"default-dockercfg-rnrrd\""
Sep 08 00:23:37.296852 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.296797    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:23:37.454211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454155    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.454384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454220    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.454384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454315    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.454384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454358    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mgsv\" (UniqueName: \"kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.454568 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.454624 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.454606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.556966    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557020    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557061    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557088    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mgsv\" (UniqueName: \"kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557182    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557247    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557734    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.557983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.557798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.558132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.558091    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.560336 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.560307    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.560584 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.560566    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.564814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.564793    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mgsv\" (UniqueName: \"kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv\") pod \"auth-test-model-8978e7-kserve-545f5fdf95-crdtd\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.600083 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.600060    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:37.891026 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.890995    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:23:37.892496 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:37.892468    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65a20fe0_183f_47c9_ac51_e04ad1582bac.slice/crio-e78836192995d911313ddee4d67337d9c854ba5a35c20204773ed633041c2f01 WatchSource:0}: Error finding container e78836192995d911313ddee4d67337d9c854ba5a35c20204773ed633041c2f01: Status 404 returned error can't find the container with id e78836192995d911313ddee4d67337d9c854ba5a35c20204773ed633041c2f01
Sep 08 00:23:37.909009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.908981    2580 patch_prober.go:28] interesting pod/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused" start-of-body=
Sep 08 00:23:37.909105 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.909018    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.80:15021/healthz/ready\": dial tcp 10.132.0.80:15021: connect: connection refused"
Sep 08 00:23:37.982306 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:37.982275    2580 scope.go:117] "RemoveContainer" containerID="e478a19245b1cb4aa2bc3655f9c91aa1002a32b740a4524ab8b97119c955dd0a"
Sep 08 00:23:38.551936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.551906    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" event={"ID":"65a20fe0-183f-47c9-ac51-e04ad1582bac","Type":"ContainerStarted","Data":"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"}
Sep 08 00:23:38.551936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.551944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" event={"ID":"65a20fe0-183f-47c9-ac51-e04ad1582bac","Type":"ContainerStarted","Data":"e78836192995d911313ddee4d67337d9c854ba5a35c20204773ed633041c2f01"}
Sep 08 00:23:38.566548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.566503    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" podStartSLOduration=1.5664886770000002 podStartE2EDuration="1.566488677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:38.565769507 +0000 UTC m=+1261.316466354" watchObservedRunningTime="2026-09-08 00:23:38.566488677 +0000 UTC m=+1261.317185546"
Sep 08 00:23:38.880789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.880703    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:38.886509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.886465    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:38.886680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.886655    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:38.888801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.888780    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-79v5x\""
Sep 08 00:23:38.912484 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.912437    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:38.912819 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.912785    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:38.913545 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:38.913525    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:23:39.071805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.071754    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6pjq\" (UniqueName: \"kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq\") pod \"test-curl-7856-140246014706432\" (UID: \"fd2108d1-e033-44a7-8712-79f65b9de214\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:39.173128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.173044    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6pjq\" (UniqueName: \"kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq\") pod \"test-curl-7856-140246014706432\" (UID: \"fd2108d1-e033-44a7-8712-79f65b9de214\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:39.180211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.180179    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6pjq\" (UniqueName: \"kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq\") pod \"test-curl-7856-140246014706432\" (UID: \"fd2108d1-e033-44a7-8712-79f65b9de214\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:39.198359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.198339    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:39.465863 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.465837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:39.466625 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:39.466599    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd2108d1_e033_44a7_8712_79f65b9de214.slice/crio-390cd638fb0d92f2d7743c535163c8b6e312107ee2ee8f2347466e3948d97884 WatchSource:0}: Error finding container 390cd638fb0d92f2d7743c535163c8b6e312107ee2ee8f2347466e3948d97884: Status 404 returned error can't find the container with id 390cd638fb0d92f2d7743c535163c8b6e312107ee2ee8f2347466e3948d97884
Sep 08 00:23:39.468022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.468007    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:23:39.560105 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:39.560077    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014706432" event={"ID":"fd2108d1-e033-44a7-8712-79f65b9de214","Type":"ContainerStarted","Data":"390cd638fb0d92f2d7743c535163c8b6e312107ee2ee8f2347466e3948d97884"}
Sep 08 00:23:40.567994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:40.567960    2580 generic.go:356] "Generic (PLEG): container finished" podID="fd2108d1-e033-44a7-8712-79f65b9de214" containerID="874a57af8bc3d55cace5ae8ed488f346e6f5018c2dad0fdf58ff7b4b279f0ef1" exitCode=0
Sep 08 00:23:40.568411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:40.568040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014706432" event={"ID":"fd2108d1-e033-44a7-8712-79f65b9de214","Type":"ContainerDied","Data":"874a57af8bc3d55cace5ae8ed488f346e6f5018c2dad0fdf58ff7b4b279f0ef1"}
Sep 08 00:23:41.712102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.712080    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:41.742040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.742014    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7856-140246014706432_fd2108d1-e033-44a7-8712-79f65b9de214/test-curl-7856-140246014706432/0.log"
Sep 08 00:23:41.762140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.762113    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:41.765087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.765068    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:41.883389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.883320    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:41.883803 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.883785    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd2108d1-e033-44a7-8712-79f65b9de214" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:41.883898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.883805    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd2108d1-e033-44a7-8712-79f65b9de214" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:41.883976 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.883963    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd2108d1-e033-44a7-8712-79f65b9de214" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:41.887056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.887036    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:41.890074 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.890054    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:41.897860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.897842    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6pjq\" (UniqueName: \"kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq\") pod \"fd2108d1-e033-44a7-8712-79f65b9de214\" (UID: \"fd2108d1-e033-44a7-8712-79f65b9de214\") "
Sep 08 00:23:41.899859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.899830    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq" (OuterVolumeSpecName: "kube-api-access-n6pjq") pod "fd2108d1-e033-44a7-8712-79f65b9de214" (UID: "fd2108d1-e033-44a7-8712-79f65b9de214"). InnerVolumeSpecName "kube-api-access-n6pjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:23:41.998801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.998770    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdgpt\" (UniqueName: \"kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt\") pod \"test-curl-7856-140246014706432\" (UID: \"30e9ece2-50fe-4d5b-8595-3e93c5bce749\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:41.998963 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:41.998938    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6pjq\" (UniqueName: \"kubernetes.io/projected/fd2108d1-e033-44a7-8712-79f65b9de214-kube-api-access-n6pjq\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:23:42.100231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.100207    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdgpt\" (UniqueName: \"kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt\") pod \"test-curl-7856-140246014706432\" (UID: \"30e9ece2-50fe-4d5b-8595-3e93c5bce749\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:42.107128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.107102    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdgpt\" (UniqueName: \"kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt\") pod \"test-curl-7856-140246014706432\" (UID: \"30e9ece2-50fe-4d5b-8595-3e93c5bce749\") " pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:42.196900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.196839    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:42.466983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.466955    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:42.468467 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:42.468431    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30e9ece2_50fe_4d5b_8595_3e93c5bce749.slice/crio-0949649e93d190fce9bee522d6a26ac9db3e791f0bcc74c15e554e32365eace6 WatchSource:0}: Error finding container 0949649e93d190fce9bee522d6a26ac9db3e791f0bcc74c15e554e32365eace6: Status 404 returned error can't find the container with id 0949649e93d190fce9bee522d6a26ac9db3e791f0bcc74c15e554e32365eace6
Sep 08 00:23:42.585441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.585416    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:42.585568 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.585494    2580 scope.go:117] "RemoveContainer" containerID="874a57af8bc3d55cace5ae8ed488f346e6f5018c2dad0fdf58ff7b4b279f0ef1"
Sep 08 00:23:42.586886 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.586856    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014706432" event={"ID":"30e9ece2-50fe-4d5b-8595-3e93c5bce749","Type":"ContainerStarted","Data":"0949649e93d190fce9bee522d6a26ac9db3e791f0bcc74c15e554e32365eace6"}
Sep 08 00:23:42.874977 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:42.874908    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:23:43.595800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:43.595737    2580 generic.go:356] "Generic (PLEG): container finished" podID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" containerID="d738cfcb9edfe566a1e20a3d734cdfbf3a9017251729493f3ff18dbb9180a2e5" exitCode=0
Sep 08 00:23:43.595926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:43.595799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014706432" event={"ID":"30e9ece2-50fe-4d5b-8595-3e93c5bce749","Type":"ContainerDied","Data":"d738cfcb9edfe566a1e20a3d734cdfbf3a9017251729493f3ff18dbb9180a2e5"}
Sep 08 00:23:43.779806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:43.779762    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd2108d1-e033-44a7-8712-79f65b9de214" path="/var/lib/kubelet/pods/fd2108d1-e033-44a7-8712-79f65b9de214/volumes"
Sep 08 00:23:44.738480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.738443    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:44.754981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.754957    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7856-140246014706432_30e9ece2-50fe-4d5b-8595-3e93c5bce749/test-curl-7856-140246014706432/0.log"
Sep 08 00:23:44.775850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.775832    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:44.778154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.778134    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7856-140246014706432"]
Sep 08 00:23:44.822182 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.822158    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdgpt\" (UniqueName: \"kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt\") pod \"30e9ece2-50fe-4d5b-8595-3e93c5bce749\" (UID: \"30e9ece2-50fe-4d5b-8595-3e93c5bce749\") "
Sep 08 00:23:44.824265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.824234    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt" (OuterVolumeSpecName: "kube-api-access-jdgpt") pod "30e9ece2-50fe-4d5b-8595-3e93c5bce749" (UID: "30e9ece2-50fe-4d5b-8595-3e93c5bce749"). InnerVolumeSpecName "kube-api-access-jdgpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:23:44.880010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.879956    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:44.880369 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.880356    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:44.880412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.880371    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:44.880447 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.880436    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" containerName="test-curl-7856-140246014706432"
Sep 08 00:23:44.883343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.883329    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:44.889087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.889064    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:44.923201 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.923177    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hhn8\" (UniqueName: \"kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8\") pod \"test-curl-7856-140246014707008\" (UID: \"81be41a8-3620-44d5-865b-61d87165e3c5\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:44.923383 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:44.923363    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdgpt\" (UniqueName: \"kubernetes.io/projected/30e9ece2-50fe-4d5b-8595-3e93c5bce749-kube-api-access-jdgpt\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:23:45.024528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.024502    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hhn8\" (UniqueName: \"kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8\") pod \"test-curl-7856-140246014707008\" (UID: \"81be41a8-3620-44d5-865b-61d87165e3c5\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:45.031971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.031942    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hhn8\" (UniqueName: \"kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8\") pod \"test-curl-7856-140246014707008\" (UID: \"81be41a8-3620-44d5-865b-61d87165e3c5\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:45.194276 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.194204    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:45.462911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.462889    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:45.464070 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:45.464044    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81be41a8_3620_44d5_865b_61d87165e3c5.slice/crio-88a2812a505a132a1c6eec75d54a0aa0f4382783b22c8b8758580c31d197aca8 WatchSource:0}: Error finding container 88a2812a505a132a1c6eec75d54a0aa0f4382783b22c8b8758580c31d197aca8: Status 404 returned error can't find the container with id 88a2812a505a132a1c6eec75d54a0aa0f4382783b22c8b8758580c31d197aca8
Sep 08 00:23:45.610120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.610090    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014707008" event={"ID":"81be41a8-3620-44d5-865b-61d87165e3c5","Type":"ContainerStarted","Data":"88a2812a505a132a1c6eec75d54a0aa0f4382783b22c8b8758580c31d197aca8"}
Sep 08 00:23:45.611478 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.611445    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0949649e93d190fce9bee522d6a26ac9db3e791f0bcc74c15e554e32365eace6"
Sep 08 00:23:45.611577 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.611487    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:45.621564 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:23:45.621536    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7856-140246014706432\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" pod="opendatahub/test-curl-7856-140246014706432"
Sep 08 00:23:45.773729 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:45.773678    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30e9ece2-50fe-4d5b-8595-3e93c5bce749" path="/var/lib/kubelet/pods/30e9ece2-50fe-4d5b-8595-3e93c5bce749/volumes"
Sep 08 00:23:46.623487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:46.623436    2580 generic.go:356] "Generic (PLEG): container finished" podID="81be41a8-3620-44d5-865b-61d87165e3c5" containerID="83873d239861a301ff82f0dbed022e7f8477b264bc6b0dce6edcda46344dae8a" exitCode=0
Sep 08 00:23:46.623600 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:46.623518    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014707008" event={"ID":"81be41a8-3620-44d5-865b-61d87165e3c5","Type":"ContainerDied","Data":"83873d239861a301ff82f0dbed022e7f8477b264bc6b0dce6edcda46344dae8a"}
Sep 08 00:23:47.600702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.600665    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:47.601174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.600721    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:47.612770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.612749    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:47.642542 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.642516    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:23:47.778934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.778911    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:47.795403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.795385    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7856-140246014707008_81be41a8-3620-44d5-865b-61d87165e3c5/test-curl-7856-140246014707008/0.log"
Sep 08 00:23:47.814604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.814580    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:47.817151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.817133    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:47.849492 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.849446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hhn8\" (UniqueName: \"kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8\") pod \"81be41a8-3620-44d5-865b-61d87165e3c5\" (UID: \"81be41a8-3620-44d5-865b-61d87165e3c5\") "
Sep 08 00:23:47.851494 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.851434    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8" (OuterVolumeSpecName: "kube-api-access-7hhn8") pod "81be41a8-3620-44d5-865b-61d87165e3c5" (UID: "81be41a8-3620-44d5-865b-61d87165e3c5"). InnerVolumeSpecName "kube-api-access-7hhn8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:23:47.951692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.951573    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hhn8\" (UniqueName: \"kubernetes.io/projected/81be41a8-3620-44d5-865b-61d87165e3c5-kube-api-access-7hhn8\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:23:47.951692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.951638    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:47.953019 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.952984    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81be41a8-3620-44d5-865b-61d87165e3c5" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:47.953278 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.953258    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="81be41a8-3620-44d5-865b-61d87165e3c5" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:47.953601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.953581    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="81be41a8-3620-44d5-865b-61d87165e3c5" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:47.956769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.956751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:47.956870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:47.956840    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.052841 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.052814    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stzh\" (UniqueName: \"kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh\") pod \"test-curl-7856-140246014707008\" (UID: \"cf9678e1-11a8-494f-a346-793d9d2a448a\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.153834 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.153773    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stzh\" (UniqueName: \"kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh\") pod \"test-curl-7856-140246014707008\" (UID: \"cf9678e1-11a8-494f-a346-793d9d2a448a\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.160997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.160976    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stzh\" (UniqueName: \"kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh\") pod \"test-curl-7856-140246014707008\" (UID: \"cf9678e1-11a8-494f-a346-793d9d2a448a\") " pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.266801 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.266776    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.538090 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.538065    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:48.538909 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:48.538881    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf9678e1_11a8_494f_a346_793d9d2a448a.slice/crio-a72b55fb51d98a30adb02e364f920fc5a574ef2fe4dc761d4f56e5c859261445 WatchSource:0}: Error finding container a72b55fb51d98a30adb02e364f920fc5a574ef2fe4dc761d4f56e5c859261445: Status 404 returned error can't find the container with id a72b55fb51d98a30adb02e364f920fc5a574ef2fe4dc761d4f56e5c859261445
Sep 08 00:23:48.638053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.638029    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="88a2812a505a132a1c6eec75d54a0aa0f4382783b22c8b8758580c31d197aca8"
Sep 08 00:23:48.638053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.638032    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:48.639528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.639501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014707008" event={"ID":"cf9678e1-11a8-494f-a346-793d9d2a448a","Type":"ContainerStarted","Data":"a72b55fb51d98a30adb02e364f920fc5a574ef2fe4dc761d4f56e5c859261445"}
Sep 08 00:23:48.649559 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:48.649535    2580 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7856-140246014707008" oldPodUID="81be41a8-3620-44d5-865b-61d87165e3c5" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a"
Sep 08 00:23:49.647194 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:49.647160    2580 generic.go:356] "Generic (PLEG): container finished" podID="cf9678e1-11a8-494f-a346-793d9d2a448a" containerID="f59f785381ed8b48c1fd5a5cf7ff562ff9af44de3a8212f49841cb5d45e35799" exitCode=0
Sep 08 00:23:49.647631 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:49.647254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7856-140246014707008" event={"ID":"cf9678e1-11a8-494f-a346-793d9d2a448a","Type":"ContainerDied","Data":"f59f785381ed8b48c1fd5a5cf7ff562ff9af44de3a8212f49841cb5d45e35799"}
Sep 08 00:23:49.773937 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:49.773905    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81be41a8-3620-44d5-865b-61d87165e3c5" path="/var/lib/kubelet/pods/81be41a8-3620-44d5-865b-61d87165e3c5/volumes"
Sep 08 00:23:50.788006 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.787982    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:50.806248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.806228    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7856-140246014707008_cf9678e1-11a8-494f-a346-793d9d2a448a/test-curl-7856-140246014707008/0.log"
Sep 08 00:23:50.828445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.828421    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:50.832041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.832017    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7856-140246014707008"]
Sep 08 00:23:50.878984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.878963    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8stzh\" (UniqueName: \"kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh\") pod \"cf9678e1-11a8-494f-a346-793d9d2a448a\" (UID: \"cf9678e1-11a8-494f-a346-793d9d2a448a\") "
Sep 08 00:23:50.880923 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.880904    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh" (OuterVolumeSpecName: "kube-api-access-8stzh") pod "cf9678e1-11a8-494f-a346-793d9d2a448a" (UID: "cf9678e1-11a8-494f-a346-793d9d2a448a"). InnerVolumeSpecName "kube-api-access-8stzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:23:50.980763 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:50.980739    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8stzh\" (UniqueName: \"kubernetes.io/projected/cf9678e1-11a8-494f-a346-793d9d2a448a-kube-api-access-8stzh\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:23:51.661338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.661312    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:51.661338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.661329    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a72b55fb51d98a30adb02e364f920fc5a574ef2fe4dc761d4f56e5c859261445"
Sep 08 00:23:51.671525 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:23:51.671498    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7856-140246014707008\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:51.694476 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.694392    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:23:51.694862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.694843    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:51.694862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.694863    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:51.694993 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.694933    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" containerName="test-curl-7856-140246014707008"
Sep 08 00:23:51.698181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.698164    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.700188 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.700169    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b1c04f8f-openshift-default-dockercfg-ccjkd\""
Sep 08 00:23:51.710358 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.710335    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:23:51.719650 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:23:51.719621    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7856-140246014707008\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" pod="opendatahub/test-curl-7856-140246014707008"
Sep 08 00:23:51.774774 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.774744    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf9678e1-11a8-494f-a346-793d9d2a448a" path="/var/lib/kubelet/pods/cf9678e1-11a8-494f-a346-793d9d2a448a/volumes"
Sep 08 00:23:51.786970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.786944    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787077 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787004    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787062    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787103    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsmgs\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787138    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787159    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787231    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787280    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.787327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.787317    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.888910 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.888876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.888928    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.888971    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.888995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsmgs\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889021    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889040    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889066    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889195    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889245    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889393 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889366    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889402    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889656    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889685    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.889839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.889822    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.891463 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.891429    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.891684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.891664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.896037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.896018    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:51.896115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:51.896066    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsmgs\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs\") pod \"e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") " pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:52.010080 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.010051    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:52.293848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.293821    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:23:52.295602 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:23:52.295576    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49dbc6ec_3d42_486b_99e6_8a141cca10d5.slice/crio-44710114760ec1eddbfb9aba06c93b8a7a39f577b94df17c39e8777e1191d88b WatchSource:0}: Error finding container 44710114760ec1eddbfb9aba06c93b8a7a39f577b94df17c39e8777e1191d88b: Status 404 returned error can't find the container with id 44710114760ec1eddbfb9aba06c93b8a7a39f577b94df17c39e8777e1191d88b
Sep 08 00:23:52.298130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.298096    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:52.298224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.298163    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:52.298224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.298194    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:23:52.671718 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.671635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerStarted","Data":"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"}
Sep 08 00:23:52.671718 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.671690    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerStarted","Data":"44710114760ec1eddbfb9aba06c93b8a7a39f577b94df17c39e8777e1191d88b"}
Sep 08 00:23:52.688533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:52.688489    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podStartSLOduration=1.688444548 podStartE2EDuration="1.688444548s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:23:52.688080066 +0000 UTC m=+1275.438776903" watchObservedRunningTime="2026-09-08 00:23:52.688444548 +0000 UTC m=+1275.439141393"
Sep 08 00:23:53.010768 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:53.010735    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:53.015746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:53.015724    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:53.678186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:53.678154    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:23:53.679205 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:23:53.679188    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:24:03.685931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:03.685899    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:24:13.812746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.812714    2580 generic.go:356] "Generic (PLEG): container finished" podID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerID="35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e" exitCode=0
Sep 08 00:24:13.813200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.812748    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerDied","Data":"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"}
Sep 08 00:24:13.813200 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.813113    2580 scope.go:117] "RemoveContainer" containerID="35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"
Sep 08 00:24:13.814191 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.814160    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:24:13.814278 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.814223    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:24:13.814278 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:13.814254    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:24:14.822279 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:14.821555    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerStarted","Data":"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"}
Sep 08 00:24:15.010475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:15.010434    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:24:15.010708 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:15.010685    2580 patch_prober.go:28] interesting pod/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 08 00:24:15.010812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:15.010742    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 08 00:24:16.011040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:16.011006    2580 patch_prober.go:28] interesting pod/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 08 00:24:16.011418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:16.011066    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 08 00:24:17.010399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:17.010367    2580 patch_prober.go:28] interesting pod/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 08 00:24:17.010553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:17.010435    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 08 00:24:18.011082 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:18.011045    2580 patch_prober.go:28] interesting pod/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 08 00:24:18.011518 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:18.011110    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 08 00:24:19.010686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:19.010652    2580 patch_prober.go:28] interesting pod/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Sep 08 00:24:19.010876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:19.010715    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Sep 08 00:24:20.015019 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:20.014991    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:24:20.015402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:20.015341    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:24:20.016013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:20.015998    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:24:26.474159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.474130    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:24:26.478770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.478750    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.481622 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.481588    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"openshift-service-ca.crt\""
Sep 08 00:24:26.481741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.481588    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"default-dockercfg-8pkln\""
Sep 08 00:24:26.481741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.481593    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"kube-root-ca.crt\""
Sep 08 00:24:26.481915 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.481882    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"auth-test-model-b8c8cd-kserve-self-signed-certs\""
Sep 08 00:24:26.485580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.485535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:24:26.521011 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.520986    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.521108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.521035    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.521108 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.521079    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvxrj\" (UniqueName: \"kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.521213 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.521144    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.521255 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.521228    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.521305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.521266    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.622781 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.622729    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.622990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.622826    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvxrj\" (UniqueName: \"kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.622990 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.622897    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623118 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.622996    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623118 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.623053    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623118 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.623091    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623369 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.623320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.623438    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.623594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.623535    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.625811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.625781    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.626145 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.626123    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.633272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.633249    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvxrj\" (UniqueName: \"kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj\") pod \"auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:26.789559 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:26.789475    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:27.066626 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:27.066592    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:24:27.067480 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:24:27.067433    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb69f2f14_f427_49c1_aab9_a78009c915b2.slice/crio-1a67b64cdab3c188ec5407da5d1f95087ea45ca00e02ad060d081da96d64f7bd WatchSource:0}: Error finding container 1a67b64cdab3c188ec5407da5d1f95087ea45ca00e02ad060d081da96d64f7bd: Status 404 returned error can't find the container with id 1a67b64cdab3c188ec5407da5d1f95087ea45ca00e02ad060d081da96d64f7bd
Sep 08 00:24:27.918344 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:27.918307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" event={"ID":"b69f2f14-f427-49c1-aab9-a78009c915b2","Type":"ContainerStarted","Data":"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"}
Sep 08 00:24:27.918727 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:27.918351    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" event={"ID":"b69f2f14-f427-49c1-aab9-a78009c915b2","Type":"ContainerStarted","Data":"1a67b64cdab3c188ec5407da5d1f95087ea45ca00e02ad060d081da96d64f7bd"}
Sep 08 00:24:27.934183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:27.934130    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" podStartSLOduration=1.934111928 podStartE2EDuration="1.934111928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:24:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:24:27.932945666 +0000 UTC m=+1310.683642509" watchObservedRunningTime="2026-09-08 00:24:27.934111928 +0000 UTC m=+1310.684808775"
Sep 08 00:24:32.977099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:32.977061    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:24:36.790228 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:36.790196    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:36.790636 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:36.790242    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:36.802718 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:36.802695    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:36.991873 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:36.991846    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:24:38.008966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:38.008940    2580 scope.go:117] "RemoveContainer" containerID="072f8957a704444f3218b341f2153598e43edcdbdd7328b95ec5dc2ba3599258"
Sep 08 00:24:38.017973 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:38.017952    2580 scope.go:117] "RemoveContainer" containerID="e347f4ff7554a2983e9b9b7005d1df16954668822a2df9802639fa376fdc38a2"
Sep 08 00:24:47.677668 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:24:47.677638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:25:01.268864 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:01.268785    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:25:09.022400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.022365    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"]
Sep 08 00:25:09.026115 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.026094    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:09.028192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.028171    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:25:09.028314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.028178    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:25:09.033757 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.033735    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"]
Sep 08 00:25:09.104869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.104842    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg\" (UID: \"2b7f246c-39af-48f8-b5d4-ed20c157eff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:09.206244 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.206215    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg\" (UID: \"2b7f246c-39af-48f8-b5d4-ed20c157eff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:09.206849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.206829    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg\" (UID: \"2b7f246c-39af-48f8-b5d4-ed20c157eff5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:09.339475 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.339396    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:09.611298 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:09.611275    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"]
Sep 08 00:25:09.612153 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:25:09.612122    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b7f246c_39af_48f8_b5d4_ed20c157eff5.slice/crio-d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370 WatchSource:0}: Error finding container d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370: Status 404 returned error can't find the container with id d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370
Sep 08 00:25:10.202994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:10.202914    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg" event={"ID":"2b7f246c-39af-48f8-b5d4-ed20c157eff5","Type":"ContainerStarted","Data":"0ee3a81ad839be6eee73b2a9a05c5bd067e80963433ca76337f1d7e97d42fd6b"}
Sep 08 00:25:10.202994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:10.202965    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg" event={"ID":"2b7f246c-39af-48f8-b5d4-ed20c157eff5","Type":"ContainerStarted","Data":"d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370"}
Sep 08 00:25:10.216938 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:10.216896    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg" podStartSLOduration=1.21688109 podStartE2EDuration="1.21688109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:25:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:25:10.214919586 +0000 UTC m=+1352.965616430" watchObservedRunningTime="2026-09-08 00:25:10.21688109 +0000 UTC m=+1352.967577929"
Sep 08 00:25:11.211328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:11.211292    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b7f246c-39af-48f8-b5d4-ed20c157eff5" containerID="0ee3a81ad839be6eee73b2a9a05c5bd067e80963433ca76337f1d7e97d42fd6b" exitCode=0
Sep 08 00:25:11.211730 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:11.211376    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg" event={"ID":"2b7f246c-39af-48f8-b5d4-ed20c157eff5","Type":"ContainerDied","Data":"0ee3a81ad839be6eee73b2a9a05c5bd067e80963433ca76337f1d7e97d42fd6b"}
Sep 08 00:25:12.361627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:12.361603    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:12.440238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:12.439602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca\") pod \"2b7f246c-39af-48f8-b5d4-ed20c157eff5\" (UID: \"2b7f246c-39af-48f8-b5d4-ed20c157eff5\") "
Sep 08 00:25:12.441982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:12.440672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b7f246c-39af-48f8-b5d4-ed20c157eff5" (UID: "2b7f246c-39af-48f8-b5d4-ed20c157eff5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:25:12.541197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:12.541140    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b7f246c-39af-48f8-b5d4-ed20c157eff5-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:25:13.225912 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:13.225884    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"
Sep 08 00:25:13.226112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:13.225917    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg" event={"ID":"2b7f246c-39af-48f8-b5d4-ed20c157eff5","Type":"ContainerDied","Data":"d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370"}
Sep 08 00:25:13.226112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:13.225964    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d930597582eebce43d6d28487dc67360dc99a6c96459349543016d60160bf370"
Sep 08 00:25:19.570628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:19.570587    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:25:24.668035 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:24.668002    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"]
Sep 08 00:25:24.670882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:24.670858    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-b1c04f8f-z92vg"]
Sep 08 00:25:25.774392 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:25.774359    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b7f246c-39af-48f8-b5d4-ed20c157eff5" path="/var/lib/kubelet/pods/2b7f246c-39af-48f8-b5d4-ed20c157eff5/volumes"
Sep 08 00:25:37.267702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:37.267662    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:25:38.052779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:38.052746    2580 scope.go:117] "RemoveContainer" containerID="853b991138dbe185d805e93e0865b4563d737b95edc2dffb0fda439521a53efa"
Sep 08 00:25:38.061848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:38.061825    2580 scope.go:117] "RemoveContainer" containerID="4f17fce9f228b52a919a8f8183f28012864532a2fa9b58b874cf86856250b099"
Sep 08 00:25:51.670632 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:25:51.670595    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:26:08.271028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:08.270993    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:26:24.780377 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:24.780343    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:26:29.369949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:29.369915    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:26:29.370429 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:29.370173    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy" containerID="cri-o://2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4" gracePeriod=30
Sep 08 00:26:31.405099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:31.405016    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:26:32.469812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:32.469778    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:26:34.629232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.629210    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:26:34.753156 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753128    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753183    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753215    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753257    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753292    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsmgs\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753318    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753395    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:34.753567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753518    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753530    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:34.753567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753554    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753590    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo\") pod \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\" (UID: \"49dbc6ec-3d42-486b-99e6-8a141cca10d5\") "
Sep 08 00:26:34.753837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753640    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:34.753837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753650    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:26:34.753837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753742    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:34.754050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753944    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.754050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753963    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.754050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753976    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.754050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753985    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.754050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.753995    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.755753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.755723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:34.755865 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.755802    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs" (OuterVolumeSpecName: "kube-api-access-dsmgs") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "kube-api-access-dsmgs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:26:34.755945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.755922    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:26:34.755992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.755924    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "49dbc6ec-3d42-486b-99e6-8a141cca10d5" (UID: "49dbc6ec-3d42-486b-99e6-8a141cca10d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:26:34.765877 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.765852    2580 generic.go:356] "Generic (PLEG): container finished" podID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerID="2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4" exitCode=0
Sep 08 00:26:34.765971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.765898    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"
Sep 08 00:26:34.765971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.765915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerDied","Data":"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"}
Sep 08 00:26:34.765971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.765959    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r" event={"ID":"49dbc6ec-3d42-486b-99e6-8a141cca10d5","Type":"ContainerDied","Data":"44710114760ec1eddbfb9aba06c93b8a7a39f577b94df17c39e8777e1191d88b"}
Sep 08 00:26:34.766097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.765979    2580 scope.go:117] "RemoveContainer" containerID="2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"
Sep 08 00:26:34.777812 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.777794    2580 scope.go:117] "RemoveContainer" containerID="35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"
Sep 08 00:26:34.786851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.786833    2580 scope.go:117] "RemoveContainer" containerID="2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"
Sep 08 00:26:34.787168 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:26:34.787146    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4\": container with ID starting with 2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4 not found: ID does not exist" containerID="2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"
Sep 08 00:26:34.787235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.787179    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4"} err="failed to get container status \"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4\": rpc error: code = NotFound desc = could not find container \"2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4\": container with ID starting with 2064e62854a86eda4ce61bd2bf3837cb731578c5ffb288be1ed9f15558d283d4 not found: ID does not exist"
Sep 08 00:26:34.787235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.787201    2580 scope.go:117] "RemoveContainer" containerID="35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"
Sep 08 00:26:34.787566 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:26:34.787542    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e\": container with ID starting with 35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e not found: ID does not exist" containerID="35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"
Sep 08 00:26:34.787642 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.787573    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e"} err="failed to get container status \"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e\": rpc error: code = NotFound desc = could not find container \"35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e\": container with ID starting with 35a173ebe792faae20560e8c808b95dc6e4d4a8344de22809b748dc8b481530e not found: ID does not exist"
Sep 08 00:26:34.789366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.789340    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:26:34.792114 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.792090    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b1c04f8f-openshift-default-6d8d4cd8f6-6984r"]
Sep 08 00:26:34.855354 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.855329    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.855354 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.855351    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.855508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.855364    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:34.855508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:34.855377    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsmgs\" (UniqueName: \"kubernetes.io/projected/49dbc6ec-3d42-486b-99e6-8a141cca10d5-kube-api-access-dsmgs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:35.774869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:35.774830    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" path="/var/lib/kubelet/pods/49dbc6ec-3d42-486b-99e6-8a141cca10d5/volumes"
Sep 08 00:26:36.670966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:36.670931    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:26:38.089010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:38.088974    2580 scope.go:117] "RemoveContainer" containerID="56497d6d5f20a586ddd9ecb286b36a0043c361646553b92144e97af1427699cb"
Sep 08 00:26:38.100859 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:38.100835    2580 scope.go:117] "RemoveContainer" containerID="7a3bed3fb15c69a05a28b2e671dbe645bd28d60366e13c6a34becdf4f13d0175"
Sep 08 00:26:40.977634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.977602    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:26:40.978037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978018    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:26:40.978102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978041    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:26:40.978102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978062    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:26:40.978102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978071    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:26:40.978102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978081    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b7f246c-39af-48f8-b5d4-ed20c157eff5" containerName="revoke-keys"
Sep 08 00:26:40.978102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978089    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b7f246c-39af-48f8-b5d4-ed20c157eff5" containerName="revoke-keys"
Sep 08 00:26:40.978299 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978201    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b7f246c-39af-48f8-b5d4-ed20c157eff5" containerName="revoke-keys"
Sep 08 00:26:40.978299 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.978212    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:26:40.982723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.982706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:40.984741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.984720    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"sub-test-model-8978e7-kserve-self-signed-certs\""
Sep 08 00:26:40.989713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:40.989688    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:26:41.108240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108214    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.108396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108263    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.108396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108375    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.108550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108407    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbk54\" (UniqueName: \"kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.108550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108506    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.108550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.108545    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209494    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209535    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbk54\" (UniqueName: \"kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209793 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209694    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209793 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209758    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209831    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.209906 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.209886    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.210052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.210032    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.210119 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.210099    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.210219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.210201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.211840 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.211813    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.212107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.212087    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.216165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.216143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbk54\" (UniqueName: \"kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54\") pod \"sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.294353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.294294    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:41.568399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.568374    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:26:41.569173 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:26:41.569153    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc250d7fe_da99_41e1_a707_51de28080167.slice/crio-d6b2eadce1745d037c70a8604ee6a4031c09e985d383733c35c7224e1f62bf0b WatchSource:0}: Error finding container d6b2eadce1745d037c70a8604ee6a4031c09e985d383733c35c7224e1f62bf0b: Status 404 returned error can't find the container with id d6b2eadce1745d037c70a8604ee6a4031c09e985d383733c35c7224e1f62bf0b
Sep 08 00:26:41.812192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.812157    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" event={"ID":"c250d7fe-da99-41e1-a707-51de28080167","Type":"ContainerStarted","Data":"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"}
Sep 08 00:26:41.812192 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.812190    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" event={"ID":"c250d7fe-da99-41e1-a707-51de28080167","Type":"ContainerStarted","Data":"d6b2eadce1745d037c70a8604ee6a4031c09e985d383733c35c7224e1f62bf0b"}
Sep 08 00:26:41.826789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:41.826706    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" podStartSLOduration=1.826691729 podStartE2EDuration="1.826691729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:26:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:26:41.825852077 +0000 UTC m=+1444.576548921" watchObservedRunningTime="2026-09-08 00:26:41.826691729 +0000 UTC m=+1444.577388572"
Sep 08 00:26:46.427094 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.427022    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" podUID="65a20fe0-183f-47c9-ac51-e04ad1582bac" containerName="main" containerID="cri-o://f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737" gracePeriod=45
Sep 08 00:26:46.686547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.686495    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:26:46.756694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756661    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.756842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756715    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mgsv\" (UniqueName: \"kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.756842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756814    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.756842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756838    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.757017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756870    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.757017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756914    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache" (OuterVolumeSpecName: "model-cache") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:46.757017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.756927    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm\") pod \"65a20fe0-183f-47c9-ac51-e04ad1582bac\" (UID: \"65a20fe0-183f-47c9-ac51-e04ad1582bac\") "
Sep 08 00:26:46.757174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.757111    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:46.757298 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.757269    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home" (OuterVolumeSpecName: "home") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:46.757377 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.757328    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.757377 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.757347    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.758919 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.758896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm" (OuterVolumeSpecName: "dshm") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:46.759013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.758952    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:26:46.759013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.758962    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv" (OuterVolumeSpecName: "kube-api-access-8mgsv") pod "65a20fe0-183f-47c9-ac51-e04ad1582bac" (UID: "65a20fe0-183f-47c9-ac51-e04ad1582bac"). InnerVolumeSpecName "kube-api-access-8mgsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:26:46.844152 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.844127    2580 generic.go:356] "Generic (PLEG): container finished" podID="65a20fe0-183f-47c9-ac51-e04ad1582bac" containerID="f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737" exitCode=0
Sep 08 00:26:46.844239 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.844169    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"
Sep 08 00:26:46.844239 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.844215    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" event={"ID":"65a20fe0-183f-47c9-ac51-e04ad1582bac","Type":"ContainerDied","Data":"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"}
Sep 08 00:26:46.844321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.844254    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd" event={"ID":"65a20fe0-183f-47c9-ac51-e04ad1582bac","Type":"ContainerDied","Data":"e78836192995d911313ddee4d67337d9c854ba5a35c20204773ed633041c2f01"}
Sep 08 00:26:46.844321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.844275    2580 scope.go:117] "RemoveContainer" containerID="f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"
Sep 08 00:26:46.853520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.853502    2580 scope.go:117] "RemoveContainer" containerID="f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"
Sep 08 00:26:46.853815 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:26:46.853792    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737\": container with ID starting with f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737 not found: ID does not exist" containerID="f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"
Sep 08 00:26:46.853895 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.853824    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737"} err="failed to get container status \"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737\": rpc error: code = NotFound desc = could not find container \"f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737\": container with ID starting with f33d635f85fc66896a44cf470765d4fb5f830df2beb7671c888cdd7ce24c9737 not found: ID does not exist"
Sep 08 00:26:46.858379 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.858360    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65a20fe0-183f-47c9-ac51-e04ad1582bac-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.858379 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.858379    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.858604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.858387    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65a20fe0-183f-47c9-ac51-e04ad1582bac-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.858604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.858395    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mgsv\" (UniqueName: \"kubernetes.io/projected/65a20fe0-183f-47c9-ac51-e04ad1582bac-kube-api-access-8mgsv\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:46.864950 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.864930    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:26:46.870083 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.870059    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/auth-test-model-8978e7-kserve-545f5fdf95-crdtd"]
Sep 08 00:26:46.988997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:46.988974    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:26:47.489982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.489951    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" podUID="b69f2f14-f427-49c1-aab9-a78009c915b2" containerName="main" containerID="cri-o://6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186" gracePeriod=45
Sep 08 00:26:47.762895 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.762811    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:26:47.766835 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.766803    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lvxrj\" (UniqueName: \"kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.766984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.766903    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.766984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.766938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.766984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.766974    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.767165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.767043    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.767165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.767072    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home\") pod \"b69f2f14-f427-49c1-aab9-a78009c915b2\" (UID: \"b69f2f14-f427-49c1-aab9-a78009c915b2\") "
Sep 08 00:26:47.767745 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.767322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:47.767745 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.767500    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache" (OuterVolumeSpecName: "model-cache") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:47.770347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.770303    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm" (OuterVolumeSpecName: "dshm") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:47.770712 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.770680    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home" (OuterVolumeSpecName: "home") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:26:47.776612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776587    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:47.776612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776613    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:47.776764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776626    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:47.776764 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776640    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b69f2f14-f427-49c1-aab9-a78009c915b2-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:47.777085 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776927    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj" (OuterVolumeSpecName: "kube-api-access-lvxrj") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "kube-api-access-lvxrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:26:47.777085 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.776922    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b69f2f14-f427-49c1-aab9-a78009c915b2" (UID: "b69f2f14-f427-49c1-aab9-a78009c915b2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:26:47.788257 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.788221    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65a20fe0-183f-47c9-ac51-e04ad1582bac" path="/var/lib/kubelet/pods/65a20fe0-183f-47c9-ac51-e04ad1582bac/volumes"
Sep 08 00:26:47.851664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.851641    2580 generic.go:356] "Generic (PLEG): container finished" podID="b69f2f14-f427-49c1-aab9-a78009c915b2" containerID="6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186" exitCode=0
Sep 08 00:26:47.851770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.851685    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"
Sep 08 00:26:47.851770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.851725    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" event={"ID":"b69f2f14-f427-49c1-aab9-a78009c915b2","Type":"ContainerDied","Data":"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"}
Sep 08 00:26:47.851770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.851763    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf" event={"ID":"b69f2f14-f427-49c1-aab9-a78009c915b2","Type":"ContainerDied","Data":"1a67b64cdab3c188ec5407da5d1f95087ea45ca00e02ad060d081da96d64f7bd"}
Sep 08 00:26:47.851902 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.851783    2580 scope.go:117] "RemoveContainer" containerID="6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"
Sep 08 00:26:47.860948 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.860932    2580 scope.go:117] "RemoveContainer" containerID="6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"
Sep 08 00:26:47.861213 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:26:47.861192    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186\": container with ID starting with 6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186 not found: ID does not exist" containerID="6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"
Sep 08 00:26:47.861280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.861223    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186"} err="failed to get container status \"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186\": rpc error: code = NotFound desc = could not find container \"6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186\": container with ID starting with 6aea73426e2a8127c804d9d85acbba7bbbe799a3721dbfb0d262a99b82f8f186 not found: ID does not exist"
Sep 08 00:26:47.866487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.866436    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:26:47.869823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.869805    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/auth-test-model-b8c8cd-kserve-85cbb75c87-chvbf"]
Sep 08 00:26:47.877421 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.877404    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lvxrj\" (UniqueName: \"kubernetes.io/projected/b69f2f14-f427-49c1-aab9-a78009c915b2-kube-api-access-lvxrj\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:47.877508 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:47.877424    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b69f2f14-f427-49c1-aab9-a78009c915b2-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:26:49.774729 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:49.774700    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b69f2f14-f427-49c1-aab9-a78009c915b2" path="/var/lib/kubelet/pods/b69f2f14-f427-49c1-aab9-a78009c915b2/volumes"
Sep 08 00:26:51.294466 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:51.294418    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:51.294913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:51.294485    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:51.306828 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:51.306798    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:26:51.888804 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:26:51.888778    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:27:22.621406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.621373    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:27:22.622052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622027    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65a20fe0-183f-47c9-ac51-e04ad1582bac" containerName="main"
Sep 08 00:27:22.622222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622206    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="65a20fe0-183f-47c9-ac51-e04ad1582bac" containerName="main"
Sep 08 00:27:22.622344 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622322    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b69f2f14-f427-49c1-aab9-a78009c915b2" containerName="main"
Sep 08 00:27:22.622344 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622344    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b69f2f14-f427-49c1-aab9-a78009c915b2" containerName="main"
Sep 08 00:27:22.622580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622486    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="65a20fe0-183f-47c9-ac51-e04ad1582bac" containerName="main"
Sep 08 00:27:22.622580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622500    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b69f2f14-f427-49c1-aab9-a78009c915b2" containerName="main"
Sep 08 00:27:22.622580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.622513    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="49dbc6ec-3d42-486b-99e6-8a141cca10d5" containerName="istio-proxy"
Sep 08 00:27:22.625271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.625250    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.627600 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.627579    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-93c8ee-openshift-default-dockercfg-g45kf\""
Sep 08 00:27:22.637658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.637636    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:27:22.780599 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780743 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780657    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780743 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780679    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780743 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780714    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780743 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780742    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780766    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kf62\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780855    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.780971 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780907    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.781101 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.780976    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.881784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881697    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.881784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881747    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.881784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881783    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kf62\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881811    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881843    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881893    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.881944    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882185    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882260    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882317    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882428    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882475    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882539    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.882664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.882646    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.884184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.884158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.884817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.884796    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.888914 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.888885    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.889755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.889740    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kf62\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62\") pod \"e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") " pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:22.938913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:22.938888    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:23.212913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:23.212886    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:27:23.214403 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:27:23.214377    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597b914b_daf2_4156_a07d_3daa7dc0df50.slice/crio-5261492c68a93d3ba55161992e621b71928320da8830e06912ce2fefd9f444fa WatchSource:0}: Error finding container 5261492c68a93d3ba55161992e621b71928320da8830e06912ce2fefd9f444fa: Status 404 returned error can't find the container with id 5261492c68a93d3ba55161992e621b71928320da8830e06912ce2fefd9f444fa
Sep 08 00:27:23.216613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:23.216575    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:23.216689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:23.216671    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:23.216735 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:23.216718    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:24.084526 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:24.084493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerStarted","Data":"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"}
Sep 08 00:27:24.084897 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:24.084540    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerStarted","Data":"5261492c68a93d3ba55161992e621b71928320da8830e06912ce2fefd9f444fa"}
Sep 08 00:27:24.107128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:24.107083    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podStartSLOduration=2.107069448 podStartE2EDuration="2.107069448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:24.105346438 +0000 UTC m=+1486.856043293" watchObservedRunningTime="2026-09-08 00:27:24.107069448 +0000 UTC m=+1486.857766293"
Sep 08 00:27:24.939360 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:24.939330    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:24.944206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:24.944179    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:25.091392 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:25.091358    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:25.092020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:25.092003    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:33.880125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.880086    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:27:33.884569 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.884548    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:33.888133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.888109    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"kube-root-ca.crt\""
Sep 08 00:27:33.888325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.888304    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"openshift-service-ca.crt\""
Sep 08 00:27:33.888433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.888412    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"sub-test-model-b8c8cd-kserve-self-signed-certs\""
Sep 08 00:27:33.888612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.888562    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"default-dockercfg-8pkln\""
Sep 08 00:27:33.891547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.891523    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:27:33.979702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:33.979675    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:27:34.084229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084191    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qglq\" (UniqueName: \"kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.084411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084256    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.084411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084314    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.084411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084353    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.084411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084391    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.084670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.084570    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.185609 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185521    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.185796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.185796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185701    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qglq\" (UniqueName: \"kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.185796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.185796 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185779    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.186026 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.185819    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.186126 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.186100    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.186189 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.186142    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.186263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.186246    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.187836 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.187819    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.188313 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.188294    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.192821 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.192798    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qglq\" (UniqueName: \"kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq\") pod \"sub-test-model-b8c8cd-kserve-7d96db7f79-n226s\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.197512 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.197496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:34.472405 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:34.472378    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:27:34.473669 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:27:34.473644    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod563d2318_7784_42d8_a338_65f0dafe1479.slice/crio-2a8f145addedf391969ea32f3e3d3610c181b77d86505c2e3310828c99bca747 WatchSource:0}: Error finding container 2a8f145addedf391969ea32f3e3d3610c181b77d86505c2e3310828c99bca747: Status 404 returned error can't find the container with id 2a8f145addedf391969ea32f3e3d3610c181b77d86505c2e3310828c99bca747
Sep 08 00:27:35.165376 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:35.164396    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" event={"ID":"563d2318-7784-42d8-a338-65f0dafe1479","Type":"ContainerStarted","Data":"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"}
Sep 08 00:27:35.165376 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:35.164465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" event={"ID":"563d2318-7784-42d8-a338-65f0dafe1479","Type":"ContainerStarted","Data":"2a8f145addedf391969ea32f3e3d3610c181b77d86505c2e3310828c99bca747"}
Sep 08 00:27:35.179711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:35.179653    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" podStartSLOduration=2.179630273 podStartE2EDuration="2.179630273s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:35.179084015 +0000 UTC m=+1497.929780859" watchObservedRunningTime="2026-09-08 00:27:35.179630273 +0000 UTC m=+1497.930327117"
Sep 08 00:27:37.900491 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:37.900443    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:27:37.904427 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:37.904407    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:27:38.138972 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:38.138933    2580 scope.go:117] "RemoveContainer" containerID="390e57988868fc2774565e3c51a0e9728eba9af1082a5c72cf95b547fc059e1b"
Sep 08 00:27:44.198346 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:44.198304    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:44.198779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:44.198374    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:44.211696 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:44.211673    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:44.233359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:44.233333    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:27:45.231041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.231014    2580 generic.go:356] "Generic (PLEG): container finished" podID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerID="cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed" exitCode=0
Sep 08 00:27:45.231583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.231089    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerDied","Data":"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"}
Sep 08 00:27:45.231683 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.231663    2580 scope.go:117] "RemoveContainer" containerID="cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"
Sep 08 00:27:45.232871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.232834    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:45.232978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.232922    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:45.232978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:45.232963    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:46.246296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:46.246251    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerStarted","Data":"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"}
Sep 08 00:27:46.939424 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:46.939384    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:46.939820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:46.939797    2580 patch_prober.go:28] interesting pod/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 08 00:27:46.940017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:46.939992    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 08 00:27:47.939823 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:47.939779    2580 patch_prober.go:28] interesting pod/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 08 00:27:47.940434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:47.939854    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 08 00:27:48.939566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:48.939528    2580 patch_prober.go:28] interesting pod/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 08 00:27:48.939884 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:48.939853    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 08 00:27:49.939538 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:49.939495    2580 patch_prober.go:28] interesting pod/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 08 00:27:49.939738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:49.939576    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 08 00:27:50.940259 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:50.939834    2580 patch_prober.go:28] interesting pod/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused" start-of-body=
Sep 08 00:27:50.940259 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:50.939896    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.90:15021/healthz/ready\": dial tcp 10.132.0.90:15021: connect: connection refused"
Sep 08 00:27:51.601294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.601263    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:27:51.604857 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.604835    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.607275 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.607231    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-5d0042-openshift-default-dockercfg-2m4pk\""
Sep 08 00:27:51.617888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.617867    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:27:51.672490 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672437    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672616 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672502    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672616 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672584    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672617    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtj7q\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672694 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672637    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672696    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672737    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672761 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672753    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.672860 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.672790    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774013    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774051    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtj7q\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774077    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774124    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774187    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774214    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774265    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774357    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774407    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774711    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774808 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774784    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.774871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.774804    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.775037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.775017    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.775122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.775103    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.776521 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.776495    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.777147 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.777128    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.788041 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.788015    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.789224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.789201    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtj7q\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q\") pod \"e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") " pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.918477 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.918392    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:51.944285 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.944262    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:51.944783 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.944769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:51.945509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:51.945489    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:27:52.078403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.078368    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:27:52.196624 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.196596    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:27:52.197085 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:27:52.197060    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77cf78ac_0a65_4f93_bf33_472c7320a867.slice/crio-5f1d61f207fdfadb02234c3aee7fe2ea87b3501d5a5b4efe89ead9c4958752ea WatchSource:0}: Error finding container 5f1d61f207fdfadb02234c3aee7fe2ea87b3501d5a5b4efe89ead9c4958752ea: Status 404 returned error can't find the container with id 5f1d61f207fdfadb02234c3aee7fe2ea87b3501d5a5b4efe89ead9c4958752ea
Sep 08 00:27:52.199399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.199370    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:52.199465 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.199431    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:52.199506 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.199485    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:27:52.289520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.289493    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerStarted","Data":"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"}
Sep 08 00:27:52.289661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.289550    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerStarted","Data":"5f1d61f207fdfadb02234c3aee7fe2ea87b3501d5a5b4efe89ead9c4958752ea"}
Sep 08 00:27:52.308769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.308712    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podStartSLOduration=1.308696664 podStartE2EDuration="1.308696664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:27:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:27:52.304851035 +0000 UTC m=+1515.055547878" watchObservedRunningTime="2026-09-08 00:27:52.308696664 +0000 UTC m=+1515.059393507"
Sep 08 00:27:52.918609 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:52.918569    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:53.923547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:53.923518    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:54.302900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:54.302873    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:27:54.303836 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:27:54.303813    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:28:10.344584 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:10.344546    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:28:10.345009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:10.344614    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:28:11.418273 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.418247    2580 generic.go:356] "Generic (PLEG): container finished" podID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerID="8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb" exitCode=0
Sep 08 00:28:11.418634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.418320    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerDied","Data":"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"}
Sep 08 00:28:11.418755 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.418741    2580 scope.go:117] "RemoveContainer" containerID="8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"
Sep 08 00:28:11.420012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.419983    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:28:11.420068 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.420052    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:28:11.420107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:11.420082    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:28:12.428797 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:12.428762    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerStarted","Data":"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"}
Sep 08 00:28:12.919232 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:12.919198    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:28:12.919402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:12.919348    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:12.919402 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:12.919393    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:13.381548 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:13.381513    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:28:13.919020 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:13.918984    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:13.919540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:13.919046    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:14.919325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:14.919290    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:14.919734 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:14.919346    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:15.919190 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:15.919152    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:15.919378 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:15.919211    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:16.919747 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:16.919713    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:16.920140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:16.919797    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:17.200697 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.200620    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7859-c141b3"]
Sep 08 00:28:17.204364 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.204347    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:17.206750 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.206729    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-79v5x\""
Sep 08 00:28:17.209619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.209594    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-c141b3"]
Sep 08 00:28:17.253824 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.253797    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9\") pod \"mt-curl-7859-c141b3\" (UID: \"a1646bde-341e-4c7f-86ba-6111e125ffef\") " pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:17.355025 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.354991    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9\") pod \"mt-curl-7859-c141b3\" (UID: \"a1646bde-341e-4c7f-86ba-6111e125ffef\") " pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:17.362058 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.362036    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9\") pod \"mt-curl-7859-c141b3\" (UID: \"a1646bde-341e-4c7f-86ba-6111e125ffef\") " pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:17.516104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.516075    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:17.811876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.811846    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-c141b3"]
Sep 08 00:28:17.812515 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:28:17.812490    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1646bde_341e_4c7f_86ba_6111e125ffef.slice/crio-0daba99508a7f8a28fa2e4ba104cf0b3366f7a2fe09b1d2ece0aa661e8df8480 WatchSource:0}: Error finding container 0daba99508a7f8a28fa2e4ba104cf0b3366f7a2fe09b1d2ece0aa661e8df8480: Status 404 returned error can't find the container with id 0daba99508a7f8a28fa2e4ba104cf0b3366f7a2fe09b1d2ece0aa661e8df8480
Sep 08 00:28:17.918848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.918814    2580 patch_prober.go:28] interesting pod/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused" start-of-body=
Sep 08 00:28:17.918981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:17.918879    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.92:15021/healthz/ready\": dial tcp 10.132.0.92:15021: connect: connection refused"
Sep 08 00:28:18.482797 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:18.482756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-c141b3" event={"ID":"a1646bde-341e-4c7f-86ba-6111e125ffef","Type":"ContainerStarted","Data":"0daba99508a7f8a28fa2e4ba104cf0b3366f7a2fe09b1d2ece0aa661e8df8480"}
Sep 08 00:28:18.923437 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:18.923351    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:28:18.923795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:18.923769    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:28:18.924476 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:18.924431    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:28:19.490395 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:19.490360    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1646bde-341e-4c7f-86ba-6111e125ffef" containerID="e7e1c7f664d7db90142c31e44877c7d012ecf501a9f1c7c6ee4ea13ed63f7c35" exitCode=0
Sep 08 00:28:19.490800 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:19.490441    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-c141b3" event={"ID":"a1646bde-341e-4c7f-86ba-6111e125ffef","Type":"ContainerDied","Data":"e7e1c7f664d7db90142c31e44877c7d012ecf501a9f1c7c6ee4ea13ed63f7c35"}
Sep 08 00:28:20.635878 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.635850    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:20.666901 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.666878    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7859-c141b3_a1646bde-341e-4c7f-86ba-6111e125ffef/mt-curl-7859-c141b3/0.log"
Sep 08 00:28:20.685777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.685754    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9\") pod \"a1646bde-341e-4c7f-86ba-6111e125ffef\" (UID: \"a1646bde-341e-4c7f-86ba-6111e125ffef\") "
Sep 08 00:28:20.687872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.687844    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9" (OuterVolumeSpecName: "kube-api-access-2xlk9") pod "a1646bde-341e-4c7f-86ba-6111e125ffef" (UID: "a1646bde-341e-4c7f-86ba-6111e125ffef"). InnerVolumeSpecName "kube-api-access-2xlk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:20.687980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.687965    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7859-c141b3"]
Sep 08 00:28:20.693353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.693331    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7859-c141b3"]
Sep 08 00:28:20.786867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.786803    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xlk9\" (UniqueName: \"kubernetes.io/projected/a1646bde-341e-4c7f-86ba-6111e125ffef-kube-api-access-2xlk9\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:20.799387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.799367    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7859-a69c15"]
Sep 08 00:28:20.799773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.799760    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" containerName="mt-curl-7859-c141b3"
Sep 08 00:28:20.799826 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.799774    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" containerName="mt-curl-7859-c141b3"
Sep 08 00:28:20.799874 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.799857    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" containerName="mt-curl-7859-c141b3"
Sep 08 00:28:20.802880 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.802842    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:20.806659 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.806638    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-a69c15"]
Sep 08 00:28:20.887314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.887288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6p8kp\" (UniqueName: \"kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp\") pod \"mt-curl-7859-a69c15\" (UID: \"b9bf9e04-2f86-46bc-8640-519206ff24c5\") " pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:20.988215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.988189    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6p8kp\" (UniqueName: \"kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp\") pod \"mt-curl-7859-a69c15\" (UID: \"b9bf9e04-2f86-46bc-8640-519206ff24c5\") " pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:20.994965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:20.994939    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6p8kp\" (UniqueName: \"kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp\") pod \"mt-curl-7859-a69c15\" (UID: \"b9bf9e04-2f86-46bc-8640-519206ff24c5\") " pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:21.113375 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.113318    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:21.387470 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.387433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7859-a69c15"]
Sep 08 00:28:21.388337 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:28:21.388308    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9bf9e04_2f86_46bc_8640_519206ff24c5.slice/crio-ec19ed2169bdd6fa903349b13bd3a86d9d8b35cc5c8d96a3cbadc5ef955bca82 WatchSource:0}: Error finding container ec19ed2169bdd6fa903349b13bd3a86d9d8b35cc5c8d96a3cbadc5ef955bca82: Status 404 returned error can't find the container with id ec19ed2169bdd6fa903349b13bd3a86d9d8b35cc5c8d96a3cbadc5ef955bca82
Sep 08 00:28:21.504162 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.504135    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-a69c15" event={"ID":"b9bf9e04-2f86-46bc-8640-519206ff24c5","Type":"ContainerStarted","Data":"ec19ed2169bdd6fa903349b13bd3a86d9d8b35cc5c8d96a3cbadc5ef955bca82"}
Sep 08 00:28:21.505404 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.505388    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0daba99508a7f8a28fa2e4ba104cf0b3366f7a2fe09b1d2ece0aa661e8df8480"
Sep 08 00:28:21.505514 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.505410    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:21.515625 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:21.515602    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7859-c141b3\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:21.747484 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.747442    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"]
Sep 08 00:28:21.751240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.751221    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:21.753404 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:21.753376    2580 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7859-c141b3\" is forbidden: User \"system:node:ip-10-0-135-226.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-135-226.ec2.internal' and this object" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" pod="opendatahub/mt-curl-7859-c141b3"
Sep 08 00:28:21.754272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.754191    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:28:21.754619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.754497    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:28:21.757409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.757385    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"]
Sep 08 00:28:21.774418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.774396    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1646bde-341e-4c7f-86ba-6111e125ffef" path="/var/lib/kubelet/pods/a1646bde-341e-4c7f-86ba-6111e125ffef/volumes"
Sep 08 00:28:21.795913 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.795890    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr\" (UID: \"a63d3c2f-cb25-4d18-b234-843591ea1fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:21.896633 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.896608    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr\" (UID: \"a63d3c2f-cb25-4d18-b234-843591ea1fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:21.897148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:21.897129    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr\" (UID: \"a63d3c2f-cb25-4d18-b234-843591ea1fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:22.119231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:22.119200    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:22.388481 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:22.388433    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"]
Sep 08 00:28:22.389502 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:28:22.389479    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda63d3c2f_cb25_4d18_b234_843591ea1fa2.slice/crio-e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2 WatchSource:0}: Error finding container e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2: Status 404 returned error can't find the container with id e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2
Sep 08 00:28:22.513055 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:22.513029    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr" event={"ID":"a63d3c2f-cb25-4d18-b234-843591ea1fa2","Type":"ContainerStarted","Data":"e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2"}
Sep 08 00:28:22.514620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:22.514598    2580 generic.go:356] "Generic (PLEG): container finished" podID="b9bf9e04-2f86-46bc-8640-519206ff24c5" containerID="0fece54e0d8d1f56d04c9592b18c126aa3752373ecf32b857454de1f6621e89d" exitCode=0
Sep 08 00:28:22.514713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:22.514636    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7859-a69c15" event={"ID":"b9bf9e04-2f86-46bc-8640-519206ff24c5","Type":"ContainerDied","Data":"0fece54e0d8d1f56d04c9592b18c126aa3752373ecf32b857454de1f6621e89d"}
Sep 08 00:28:23.523333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.523296    2580 generic.go:356] "Generic (PLEG): container finished" podID="a63d3c2f-cb25-4d18-b234-843591ea1fa2" containerID="3dfade777d73b54cab19c9d987597daa8ea2d7b890620ab50a1f251899bedd16" exitCode=0
Sep 08 00:28:23.523822 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.523387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr" event={"ID":"a63d3c2f-cb25-4d18-b234-843591ea1fa2","Type":"ContainerDied","Data":"3dfade777d73b54cab19c9d987597daa8ea2d7b890620ab50a1f251899bedd16"}
Sep 08 00:28:23.662484 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.662447    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:23.681740 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.681717    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7859-a69c15_b9bf9e04-2f86-46bc-8640-519206ff24c5/mt-curl-7859-a69c15/0.log"
Sep 08 00:28:23.711177 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.706196    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7859-a69c15"]
Sep 08 00:28:23.714106 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.714080    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7859-a69c15"]
Sep 08 00:28:23.714213 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.714136    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6p8kp\" (UniqueName: \"kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp\") pod \"b9bf9e04-2f86-46bc-8640-519206ff24c5\" (UID: \"b9bf9e04-2f86-46bc-8640-519206ff24c5\") "
Sep 08 00:28:23.716161 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.716140    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp" (OuterVolumeSpecName: "kube-api-access-6p8kp") pod "b9bf9e04-2f86-46bc-8640-519206ff24c5" (UID: "b9bf9e04-2f86-46bc-8640-519206ff24c5"). InnerVolumeSpecName "kube-api-access-6p8kp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:23.774028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.773971    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9bf9e04-2f86-46bc-8640-519206ff24c5" path="/var/lib/kubelet/pods/b9bf9e04-2f86-46bc-8640-519206ff24c5/volumes"
Sep 08 00:28:23.815505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:23.815481    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6p8kp\" (UniqueName: \"kubernetes.io/projected/b9bf9e04-2f86-46bc-8640-519206ff24c5-kube-api-access-6p8kp\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:24.532282 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.532251    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7859-a69c15"
Sep 08 00:28:24.532741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.532299    2580 scope.go:117] "RemoveContainer" containerID="0fece54e0d8d1f56d04c9592b18c126aa3752373ecf32b857454de1f6621e89d"
Sep 08 00:28:24.676708 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.676686    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:24.725298 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.725269    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca\") pod \"a63d3c2f-cb25-4d18-b234-843591ea1fa2\" (UID: \"a63d3c2f-cb25-4d18-b234-843591ea1fa2\") "
Sep 08 00:28:24.725586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.725565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "a63d3c2f-cb25-4d18-b234-843591ea1fa2" (UID: "a63d3c2f-cb25-4d18-b234-843591ea1fa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:28:24.826509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:24.826422    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/a63d3c2f-cb25-4d18-b234-843591ea1fa2-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:25.541633 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:25.541604    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"
Sep 08 00:28:25.542087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:25.541635    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr" event={"ID":"a63d3c2f-cb25-4d18-b234-843591ea1fa2","Type":"ContainerDied","Data":"e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2"}
Sep 08 00:28:25.542087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:25.541680    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e019b22f5d9f2135b0da8c82a44838c43138ab1c9c716aebfac64daa5d1700b2"
Sep 08 00:28:25.582229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:25.582199    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:28:26.564879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:26.564846    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:28:31.175658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:31.175624    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:28:33.680997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.680967    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:28:33.681777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681749    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a63d3c2f-cb25-4d18-b234-843591ea1fa2" containerName="revoke-keys"
Sep 08 00:28:33.681777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681777    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a63d3c2f-cb25-4d18-b234-843591ea1fa2" containerName="revoke-keys"
Sep 08 00:28:33.682016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681813    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9bf9e04-2f86-46bc-8640-519206ff24c5" containerName="mt-curl-7859-a69c15"
Sep 08 00:28:33.682016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681822    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9bf9e04-2f86-46bc-8640-519206ff24c5" containerName="mt-curl-7859-a69c15"
Sep 08 00:28:33.682016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681937    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a63d3c2f-cb25-4d18-b234-843591ea1fa2" containerName="revoke-keys"
Sep 08 00:28:33.682016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.681950    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9bf9e04-2f86-46bc-8640-519206ff24c5" containerName="mt-curl-7859-a69c15"
Sep 08 00:28:33.685487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.685468    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.687872 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.687848    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-8978e7\"/\"rate-test-model-8978e7-kserve-self-signed-certs\""
Sep 08 00:28:33.694777 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.694751    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:28:33.811125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811101    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.811233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811152    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.811233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811182    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.811319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811237    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.811319 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811279    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwx9d\" (UniqueName: \"kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.811386 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.811335    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.912952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.912914    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.912952 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.912958    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.912999    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913049    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwx9d\" (UniqueName: \"kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913078    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913120    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913378    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913425    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.913583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.913555    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.915495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.915446    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.915620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.915600    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.920446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.920421    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwx9d\" (UniqueName: \"kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d\") pod \"rate-test-model-8978e7-kserve-7b897c99cf-m2f2v\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") " pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:33.996572 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:33.996550    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:34.267388 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:34.267361    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:28:34.269607 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:28:34.269577    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod339a389f_0ed4_481b_ae1c_f91baf0be307.slice/crio-619169af7faa19de3407d98e4ad8cc9c93eb85810d6856ab0a09a7d278978a02 WatchSource:0}: Error finding container 619169af7faa19de3407d98e4ad8cc9c93eb85810d6856ab0a09a7d278978a02: Status 404 returned error can't find the container with id 619169af7faa19de3407d98e4ad8cc9c93eb85810d6856ab0a09a7d278978a02
Sep 08 00:28:34.612963 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:34.612864    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" event={"ID":"339a389f-0ed4-481b-ae1c-f91baf0be307","Type":"ContainerStarted","Data":"0610c1d34d13479d2edc75ee04e6087d873fbfc4b0e5efdf4199817a6ffcfd56"}
Sep 08 00:28:34.612963 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:34.612913    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" event={"ID":"339a389f-0ed4-481b-ae1c-f91baf0be307","Type":"ContainerStarted","Data":"619169af7faa19de3407d98e4ad8cc9c93eb85810d6856ab0a09a7d278978a02"}
Sep 08 00:28:34.627729 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:34.627681    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" podStartSLOduration=1.627666585 podStartE2EDuration="1.627666585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:28:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:28:34.626335223 +0000 UTC m=+1557.377032068" watchObservedRunningTime="2026-09-08 00:28:34.627666585 +0000 UTC m=+1557.378363429"
Sep 08 00:28:37.467955 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:37.467924    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"]
Sep 08 00:28:37.470741 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:37.470719    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-93c8ee-2d2fr"]
Sep 08 00:28:37.774789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:37.774722    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a63d3c2f-cb25-4d18-b234-843591ea1fa2" path="/var/lib/kubelet/pods/a63d3c2f-cb25-4d18-b234-843591ea1fa2/volumes"
Sep 08 00:28:38.179802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:38.179730    2580 scope.go:117] "RemoveContainer" containerID="5e9fb572b37b23967cc43519479c4edd65c2bd17f506ba886aa3716b4359201d"
Sep 08 00:28:40.602867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.602805    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" podUID="c250d7fe-da99-41e1-a707-51de28080167" containerName="main" containerID="cri-o://507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f" gracePeriod=45
Sep 08 00:28:40.869621 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.869568    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:28:40.978505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978474    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbk54\" (UniqueName: \"kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978527    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978576    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978603    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978644    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978699    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs\") pod \"c250d7fe-da99-41e1-a707-51de28080167\" (UID: \"c250d7fe-da99-41e1-a707-51de28080167\") "
Sep 08 00:28:40.978936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978885    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:40.978936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978918    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache" (OuterVolumeSpecName: "model-cache") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:40.978936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.978929    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home" (OuterVolumeSpecName: "home") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:40.979050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.979010    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:40.979050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.979023    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:40.979050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.979031    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:40.980754 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.980734    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:28:40.981008 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.980987    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm" (OuterVolumeSpecName: "dshm") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:40.981158 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:40.981144    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54" (OuterVolumeSpecName: "kube-api-access-fbk54") pod "c250d7fe-da99-41e1-a707-51de28080167" (UID: "c250d7fe-da99-41e1-a707-51de28080167"). InnerVolumeSpecName "kube-api-access-fbk54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:41.080411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.080387    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c250d7fe-da99-41e1-a707-51de28080167-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.080411 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.080409    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbk54\" (UniqueName: \"kubernetes.io/projected/c250d7fe-da99-41e1-a707-51de28080167-kube-api-access-fbk54\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.080574 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.080419    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c250d7fe-da99-41e1-a707-51de28080167-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.585381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.585344    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" podUID="563d2318-7784-42d8-a338-65f0dafe1479" containerName="main" containerID="cri-o://ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b" gracePeriod=45
Sep 08 00:28:41.665744 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.665703    2580 generic.go:356] "Generic (PLEG): container finished" podID="c250d7fe-da99-41e1-a707-51de28080167" containerID="507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f" exitCode=0
Sep 08 00:28:41.666171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.665764    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" event={"ID":"c250d7fe-da99-41e1-a707-51de28080167","Type":"ContainerDied","Data":"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"}
Sep 08 00:28:41.666171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.665801    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25" event={"ID":"c250d7fe-da99-41e1-a707-51de28080167","Type":"ContainerDied","Data":"d6b2eadce1745d037c70a8604ee6a4031c09e985d383733c35c7224e1f62bf0b"}
Sep 08 00:28:41.666171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.665825    2580 scope.go:117] "RemoveContainer" containerID="507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"
Sep 08 00:28:41.666171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.666006    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"
Sep 08 00:28:41.694737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.694628    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:28:41.697635 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.697617    2580 scope.go:117] "RemoveContainer" containerID="507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"
Sep 08 00:28:41.697969 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:41.697945    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f\": container with ID starting with 507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f not found: ID does not exist" containerID="507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"
Sep 08 00:28:41.698062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.697976    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f"} err="failed to get container status \"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f\": rpc error: code = NotFound desc = could not find container \"507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f\": container with ID starting with 507a922e61c6ac0c1361ee8c3cd133ee7d95b3faaa73bf5ed0079d48e914b60f not found: ID does not exist"
Sep 08 00:28:41.698062 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.698038    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/sub-test-model-8978e7-kserve-5b8d78d7f9-v5t25"]
Sep 08 00:28:41.777932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.777900    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c250d7fe-da99-41e1-a707-51de28080167" path="/var/lib/kubelet/pods/c250d7fe-da99-41e1-a707-51de28080167/volumes"
Sep 08 00:28:41.843647 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.843575    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:28:41.988186 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988155    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988195    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qglq\" (UniqueName: \"kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988214    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988267    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988287    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988356 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988319    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs\") pod \"563d2318-7784-42d8-a338-65f0dafe1479\" (UID: \"563d2318-7784-42d8-a338-65f0dafe1479\") "
Sep 08 00:28:41.988667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988445    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home" (OuterVolumeSpecName: "home") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:41.988667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988544    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:41.988667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988577    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache" (OuterVolumeSpecName: "model-cache") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:41.988795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988750    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.988795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988764    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.988795 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.988773    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:41.990398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.990376    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm" (OuterVolumeSpecName: "dshm") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:41.990515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.990414    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq" (OuterVolumeSpecName: "kube-api-access-4qglq") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "kube-api-access-4qglq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:41.990560 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:41.990521    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "563d2318-7784-42d8-a338-65f0dafe1479" (UID: "563d2318-7784-42d8-a338-65f0dafe1479"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:28:42.089445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.089415    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qglq\" (UniqueName: \"kubernetes.io/projected/563d2318-7784-42d8-a338-65f0dafe1479-kube-api-access-4qglq\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:42.089445 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.089438    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/563d2318-7784-42d8-a338-65f0dafe1479-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:42.089642 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.089479    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/563d2318-7784-42d8-a338-65f0dafe1479-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:42.674353 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.674320    2580 generic.go:356] "Generic (PLEG): container finished" podID="563d2318-7784-42d8-a338-65f0dafe1479" containerID="ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b" exitCode=0
Sep 08 00:28:42.674827 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.674360    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"
Sep 08 00:28:42.674827 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.674407    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" event={"ID":"563d2318-7784-42d8-a338-65f0dafe1479","Type":"ContainerDied","Data":"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"}
Sep 08 00:28:42.674827 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.674447    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s" event={"ID":"563d2318-7784-42d8-a338-65f0dafe1479","Type":"ContainerDied","Data":"2a8f145addedf391969ea32f3e3d3610c181b77d86505c2e3310828c99bca747"}
Sep 08 00:28:42.674827 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.674492    2580 scope.go:117] "RemoveContainer" containerID="ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"
Sep 08 00:28:42.684338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.684322    2580 scope.go:117] "RemoveContainer" containerID="ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"
Sep 08 00:28:42.684638 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:42.684620    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b\": container with ID starting with ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b not found: ID does not exist" containerID="ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"
Sep 08 00:28:42.684717 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.684643    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b"} err="failed to get container status \"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b\": rpc error: code = NotFound desc = could not find container \"ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b\": container with ID starting with ee3d4c62af0780a1cb5c9e323aa18bdb3baca34a9640c36c7c2d7afcc4f6094b not found: ID does not exist"
Sep 08 00:28:42.702738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.702712    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:28:42.705370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:42.705346    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/sub-test-model-b8c8cd-kserve-7d96db7f79-n226s"]
Sep 08 00:28:43.774379 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:43.774334    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="563d2318-7784-42d8-a338-65f0dafe1479" path="/var/lib/kubelet/pods/563d2318-7784-42d8-a338-65f0dafe1479/volumes"
Sep 08 00:28:43.954716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:43.954688    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:28:43.954982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:43.954949    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy" containerID="cri-o://27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219" gracePeriod=30
Sep 08 00:28:43.997519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:43.997487    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:43.997519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:43.997533    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:44.009608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.009587    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:44.298222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298186    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"]
Sep 08 00:28:44.298619 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298606    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="563d2318-7784-42d8-a338-65f0dafe1479" containerName="main"
Sep 08 00:28:44.298674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298620    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="563d2318-7784-42d8-a338-65f0dafe1479" containerName="main"
Sep 08 00:28:44.298674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298636    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c250d7fe-da99-41e1-a707-51de28080167" containerName="main"
Sep 08 00:28:44.298674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298642    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="c250d7fe-da99-41e1-a707-51de28080167" containerName="main"
Sep 08 00:28:44.298771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298714    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="563d2318-7784-42d8-a338-65f0dafe1479" containerName="main"
Sep 08 00:28:44.298771 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.298721    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="c250d7fe-da99-41e1-a707-51de28080167" containerName="main"
Sep 08 00:28:44.303366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.303340    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:44.305407 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.305362    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:28:44.305582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.305513    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:28:44.307674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.307646    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"]
Sep 08 00:28:44.408661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.408631    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5d0042-htbwm\" (UID: \"982bd8a1-8d2b-423a-9a62-461f4aa94b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:44.510197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.510166    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5d0042-htbwm\" (UID: \"982bd8a1-8d2b-423a-9a62-461f4aa94b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:44.510811 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.510790    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-5d0042-htbwm\" (UID: \"982bd8a1-8d2b-423a-9a62-461f4aa94b99\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:44.619143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.619062    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:44.702852 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.702816    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:28:44.890258 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:44.890228    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"]
Sep 08 00:28:44.891656 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:28:44.891630    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982bd8a1_8d2b_423a_9a62_461f4aa94b99.slice/crio-5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f WatchSource:0}: Error finding container 5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f: Status 404 returned error can't find the container with id 5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f
Sep 08 00:28:45.698532 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:45.698492    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm" event={"ID":"982bd8a1-8d2b-423a-9a62-461f4aa94b99","Type":"ContainerStarted","Data":"f35d3ea4fd27e9380ad78554ad653766d915e8066d375fac1bdd9773088c1c98"}
Sep 08 00:28:45.698705 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:45.698552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm" event={"ID":"982bd8a1-8d2b-423a-9a62-461f4aa94b99","Type":"ContainerStarted","Data":"5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f"}
Sep 08 00:28:45.714517 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:45.714444    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm" podStartSLOduration=1.714430418 podStartE2EDuration="1.714430418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:28:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:28:45.711585564 +0000 UTC m=+1568.462282410" watchObservedRunningTime="2026-09-08 00:28:45.714430418 +0000 UTC m=+1568.465127261"
Sep 08 00:28:46.706547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:46.706517    2580 generic.go:356] "Generic (PLEG): container finished" podID="982bd8a1-8d2b-423a-9a62-461f4aa94b99" containerID="f35d3ea4fd27e9380ad78554ad653766d915e8066d375fac1bdd9773088c1c98" exitCode=0
Sep 08 00:28:46.706962 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:46.706607    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm" event={"ID":"982bd8a1-8d2b-423a-9a62-461f4aa94b99","Type":"ContainerDied","Data":"f35d3ea4fd27e9380ad78554ad653766d915e8066d375fac1bdd9773088c1c98"}
Sep 08 00:28:47.851570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:47.851545    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:47.945471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:47.945425    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca\") pod \"982bd8a1-8d2b-423a-9a62-461f4aa94b99\" (UID: \"982bd8a1-8d2b-423a-9a62-461f4aa94b99\") "
Sep 08 00:28:47.945733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:47.945710    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "982bd8a1-8d2b-423a-9a62-461f4aa94b99" (UID: "982bd8a1-8d2b-423a-9a62-461f4aa94b99"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:28:48.046901 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:48.046835    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/982bd8a1-8d2b-423a-9a62-461f4aa94b99-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:48.722853 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:48.722818    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"
Sep 08 00:28:48.723042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:48.722863    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm" event={"ID":"982bd8a1-8d2b-423a-9a62-461f4aa94b99","Type":"ContainerDied","Data":"5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f"}
Sep 08 00:28:48.723042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:48.722949    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5890a362818bb0a3b0348637409228f99c10a2d46654f4ea65e22eb1302af64f"
Sep 08 00:28:49.221363 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.221338    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:28:49.371238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371156    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371238 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371251    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371284    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kf62\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371334    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371382    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371627    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data" (OuterVolumeSpecName: "istio-data") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:49.371850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371408    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.371850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371816    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:28:49.372012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371853    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.372012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371898    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket\") pod \"597b914b-daf2-4156-a07d-3daa7dc0df50\" (UID: \"597b914b-daf2-4156-a07d-3daa7dc0df50\") "
Sep 08 00:28:49.372012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.371933    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:49.372167 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372122    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:49.372167 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372156    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:49.372271 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372257    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.372328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372274    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.372328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372288    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.372328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372303    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.372328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.372316    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/597b914b-daf2-4156-a07d-3daa7dc0df50-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.373847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.373822    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:28:49.373991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.373966    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token" (OuterVolumeSpecName: "istio-token") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:49.373991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.373975    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:28:49.374084 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.374002    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62" (OuterVolumeSpecName: "kube-api-access-9kf62") pod "597b914b-daf2-4156-a07d-3daa7dc0df50" (UID: "597b914b-daf2-4156-a07d-3daa7dc0df50"). InnerVolumeSpecName "kube-api-access-9kf62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:28:49.473689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.473661    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kf62\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-kube-api-access-9kf62\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.473689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.473686    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.473845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.473699    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.473845 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.473711    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/597b914b-daf2-4156-a07d-3daa7dc0df50-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:28:49.732145 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.732115    2580 generic.go:356] "Generic (PLEG): container finished" podID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerID="27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219" exitCode=0
Sep 08 00:28:49.732305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.732191    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerDied","Data":"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"}
Sep 08 00:28:49.732305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.732276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb" event={"ID":"597b914b-daf2-4156-a07d-3daa7dc0df50","Type":"ContainerDied","Data":"5261492c68a93d3ba55161992e621b71928320da8830e06912ce2fefd9f444fa"}
Sep 08 00:28:49.732305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.732194    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"
Sep 08 00:28:49.732519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.732297    2580 scope.go:117] "RemoveContainer" containerID="27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"
Sep 08 00:28:49.746236 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.746214    2580 scope.go:117] "RemoveContainer" containerID="cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"
Sep 08 00:28:49.755211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.755182    2580 scope.go:117] "RemoveContainer" containerID="27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"
Sep 08 00:28:49.755530 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:49.755510    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219\": container with ID starting with 27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219 not found: ID does not exist" containerID="27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"
Sep 08 00:28:49.755639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.755537    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219"} err="failed to get container status \"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219\": rpc error: code = NotFound desc = could not find container \"27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219\": container with ID starting with 27e20117fcf4dbaf2f20ccea66eae31fbd53d6eef85f35cabb5a40f0a22b0219 not found: ID does not exist"
Sep 08 00:28:49.755639 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.755554    2580 scope.go:117] "RemoveContainer" containerID="cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"
Sep 08 00:28:49.755802 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:28:49.755787    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed\": container with ID starting with cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed not found: ID does not exist" containerID="cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"
Sep 08 00:28:49.755851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.755806    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed"} err="failed to get container status \"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed\": rpc error: code = NotFound desc = could not find container \"cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed\": container with ID starting with cf39de58c224135dec5eef8211a9e26980b2920d72a9868f75204539203990ed not found: ID does not exist"
Sep 08 00:28:49.757587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.757564    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:28:49.761364 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.761343    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-93c8ee-openshift-default-69fb4cd758-9mjdb"]
Sep 08 00:28:49.774350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:49.774332    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" path="/var/lib/kubelet/pods/597b914b-daf2-4156-a07d-3daa7dc0df50/volumes"
Sep 08 00:28:51.376367 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:51.376333    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:28:59.970561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:59.970527    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"]
Sep 08 00:28:59.973702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:28:59.973679    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-5d0042-htbwm"]
Sep 08 00:29:01.563813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.563780    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:29:01.564215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564201    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982bd8a1-8d2b-423a-9a62-461f4aa94b99" containerName="revoke-keys"
Sep 08 00:29:01.564265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564216    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="982bd8a1-8d2b-423a-9a62-461f4aa94b99" containerName="revoke-keys"
Sep 08 00:29:01.564265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564229    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:01.564265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564234    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:01.564359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564312    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="982bd8a1-8d2b-423a-9a62-461f4aa94b99" containerName="revoke-keys"
Sep 08 00:29:01.564359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564321    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:01.564359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.564327    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:01.569628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.569610    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.572657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.572634    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"openshift-service-ca.crt\""
Sep 08 00:29:01.572838 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.572815    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"kube-root-ca.crt\""
Sep 08 00:29:01.572970 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.572715    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"rate-test-model-b8c8cd-kserve-self-signed-certs\""
Sep 08 00:29:01.573085 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.572652    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-b8c8cd\"/\"default-dockercfg-8pkln\""
Sep 08 00:29:01.575215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.575191    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:29:01.582400 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582363    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.582541 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582492    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.582541 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582520    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.582670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582553    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.582670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582590    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.582670 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.582638    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq6ff\" (UniqueName: \"kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684013 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.683985    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684033    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq6ff\" (UniqueName: \"kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684072    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684133    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684172 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684153    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684580 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684549    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684688 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684553    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.684688 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.684605    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.686258 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.686238    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.686529 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.686513    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.690615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.690594    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq6ff\" (UniqueName: \"kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff\") pod \"rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") " pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:01.774377 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.774344    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="982bd8a1-8d2b-423a-9a62-461f4aa94b99" path="/var/lib/kubelet/pods/982bd8a1-8d2b-423a-9a62-461f4aa94b99/volumes"
Sep 08 00:29:01.880820 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:01.880757    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:02.155999 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:02.155966    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:29:02.156752 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:29:02.156725    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5d027ae_9502_4ca8_889a_3cff044fdc71.slice/crio-60f93d96aa877777e920b8de589aa7211b1fd323085dd81e33566622ac1aaa2a WatchSource:0}: Error finding container 60f93d96aa877777e920b8de589aa7211b1fd323085dd81e33566622ac1aaa2a: Status 404 returned error can't find the container with id 60f93d96aa877777e920b8de589aa7211b1fd323085dd81e33566622ac1aaa2a
Sep 08 00:29:02.818209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:02.818175    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" event={"ID":"d5d027ae-9502-4ca8-889a-3cff044fdc71","Type":"ContainerStarted","Data":"ebd45acf1566cf8a74aaa436f79bb3e2ade84fcdd9cb655a06efeab04b60c1ea"}
Sep 08 00:29:02.818209 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:02.818219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" event={"ID":"d5d027ae-9502-4ca8-889a-3cff044fdc71","Type":"ContainerStarted","Data":"60f93d96aa877777e920b8de589aa7211b1fd323085dd81e33566622ac1aaa2a"}
Sep 08 00:29:02.833879 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:02.833829    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" podStartSLOduration=1.833814427 podStartE2EDuration="1.833814427s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:29:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:29:02.831530758 +0000 UTC m=+1585.582227603" watchObservedRunningTime="2026-09-08 00:29:02.833814427 +0000 UTC m=+1585.584511270"
Sep 08 00:29:04.381576 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:04.381535    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:29:06.301552 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:06.301523    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:29:06.302010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:06.301767    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy" containerID="cri-o://fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380" gracePeriod=30
Sep 08 00:29:11.541073 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.541050    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:29:11.574487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574414    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574497    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574525    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574602    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574630    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574692 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574657    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574691    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data" (OuterVolumeSpecName: "istio-data") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:11.574934 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574888    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtj7q\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574950    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.574985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574949    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:11.575095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.574988    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket\") pod \"77cf78ac-0a65-4f93-bf33-472c7320a867\" (UID: \"77cf78ac-0a65-4f93-bf33-472c7320a867\") "
Sep 08 00:29:11.575095 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575046    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:11.575203 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575122    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:11.575487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575328    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:11.575487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575441    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.575487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575472    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.575487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575486    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.575731 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575498    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.575731 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.575511    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/77cf78ac-0a65-4f93-bf33-472c7320a867-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.577191 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.577157    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:29:11.577517 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.577498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:11.577586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.577539    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token" (OuterVolumeSpecName: "istio-token") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:11.577625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.577587    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q" (OuterVolumeSpecName: "kube-api-access-mtj7q") pod "77cf78ac-0a65-4f93-bf33-472c7320a867" (UID: "77cf78ac-0a65-4f93-bf33-472c7320a867"). InnerVolumeSpecName "kube-api-access-mtj7q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:11.676460 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.676427    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.676570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.676471    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtj7q\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-kube-api-access-mtj7q\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.676570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.676482    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.676570 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.676490    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/77cf78ac-0a65-4f93-bf33-472c7320a867-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:11.880929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.880869    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:11.880929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.880912    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:11.881231 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.881202    2580 generic.go:356] "Generic (PLEG): container finished" podID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerID="fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380" exitCode=0
Sep 08 00:29:11.881350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.881238    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerDied","Data":"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"}
Sep 08 00:29:11.881350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.881276    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59" event={"ID":"77cf78ac-0a65-4f93-bf33-472c7320a867","Type":"ContainerDied","Data":"5f1d61f207fdfadb02234c3aee7fe2ea87b3501d5a5b4efe89ead9c4958752ea"}
Sep 08 00:29:11.881350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.881298    2580 scope.go:117] "RemoveContainer" containerID="fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"
Sep 08 00:29:11.881350 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.881246    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"
Sep 08 00:29:11.891034 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.891015    2580 scope.go:117] "RemoveContainer" containerID="8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"
Sep 08 00:29:11.893942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.893923    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:11.900077 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.900051    2580 scope.go:117] "RemoveContainer" containerID="fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"
Sep 08 00:29:11.900334 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:11.900313    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380\": container with ID starting with fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380 not found: ID does not exist" containerID="fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"
Sep 08 00:29:11.900426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.900339    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380"} err="failed to get container status \"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380\": rpc error: code = NotFound desc = could not find container \"fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380\": container with ID starting with fb57abe4c3027a8b68fe95c93e02fe77211dab65833126287e67a048cfb78380 not found: ID does not exist"
Sep 08 00:29:11.900426 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.900356    2580 scope.go:117] "RemoveContainer" containerID="8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"
Sep 08 00:29:11.900638 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:11.900621    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb\": container with ID starting with 8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb not found: ID does not exist" containerID="8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"
Sep 08 00:29:11.900684 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.900644    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb"} err="failed to get container status \"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb\": rpc error: code = NotFound desc = could not find container \"8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb\": container with ID starting with 8e5f1f51c5a5e91f976135a09cde878be8175f760a3b1ba545044aece88251fb not found: ID does not exist"
Sep 08 00:29:11.902234 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.902210    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:29:11.905585 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:11.905566    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-5d0042-openshift-default-85fd9bfdb8-j6h59"]
Sep 08 00:29:12.899824 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:12.899793    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:29:13.775198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:13.775166    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" path="/var/lib/kubelet/pods/77cf78ac-0a65-4f93-bf33-472c7320a867/volumes"
Sep 08 00:29:20.970908 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:20.970871    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:29:23.356430 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:23.356398    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:29:23.356867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:23.356653    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" containerID="cri-o://14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c" gracePeriod=30
Sep 08 00:29:25.088403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:25.088368    2580 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:29:25.088806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:25.088435    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:29:28.608519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.608494    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:29:28.721999 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.721976    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722015    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722066    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722080    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722148 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722100    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fthh\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722212    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722253    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722286    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data" (OuterVolumeSpecName: "istio-data") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722297    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo\") pod \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\" (UID: \"e1c90888-4f7d-4b9a-84a9-63bbae312b15\") "
Sep 08 00:29:28.722370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722309    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:28.722712 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722412    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:28.722712 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722435    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:28.722815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722711    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.722815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722734    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.722815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722748    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.722815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722762    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.722815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.722795    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:28.724667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.724628    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh" (OuterVolumeSpecName: "kube-api-access-5fthh") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "kube-api-access-5fthh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:28.724921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.724897    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:29:28.724921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.724915    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token" (OuterVolumeSpecName: "istio-token") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:28.725050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.724991    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e1c90888-4f7d-4b9a-84a9-63bbae312b15" (UID: "e1c90888-4f7d-4b9a-84a9-63bbae312b15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:28.824046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.824014    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.824046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.824036    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fthh\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-kube-api-access-5fthh\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.824046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.824047    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.824292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.824055    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.824292 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.824063    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e1c90888-4f7d-4b9a-84a9-63bbae312b15-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:28.999227 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.999152    2580 generic.go:356] "Generic (PLEG): container finished" podID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerID="14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c" exitCode=0
Sep 08 00:29:28.999227 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.999192    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"
Sep 08 00:29:28.999403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.999235    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerDied","Data":"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"}
Sep 08 00:29:28.999403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.999281    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d" event={"ID":"e1c90888-4f7d-4b9a-84a9-63bbae312b15","Type":"ContainerDied","Data":"61bd2a2afa493f8c83f2572241287aeb310a199fa7d018d95744ea1e477799b4"}
Sep 08 00:29:28.999403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:28.999302    2580 scope.go:117] "RemoveContainer" containerID="14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"
Sep 08 00:29:29.009603 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.009579    2580 scope.go:117] "RemoveContainer" containerID="584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"
Sep 08 00:29:29.018045 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.018028    2580 scope.go:117] "RemoveContainer" containerID="14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"
Sep 08 00:29:29.018297 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:29.018278    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c\": container with ID starting with 14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c not found: ID does not exist" containerID="14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"
Sep 08 00:29:29.018361 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.018304    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c"} err="failed to get container status \"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c\": rpc error: code = NotFound desc = could not find container \"14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c\": container with ID starting with 14853046512ba6f41c1c33d494e48360e127562c98adb6d4423251e0fdc7b48c not found: ID does not exist"
Sep 08 00:29:29.018361 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.018320    2580 scope.go:117] "RemoveContainer" containerID="584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"
Sep 08 00:29:29.018589 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:29.018567    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579\": container with ID starting with 584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579 not found: ID does not exist" containerID="584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"
Sep 08 00:29:29.018660 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.018594    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579"} err="failed to get container status \"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579\": rpc error: code = NotFound desc = could not find container \"584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579\": container with ID starting with 584cfe06c9e38f9c11dd0acf5d5d800645205467144dafaa3b0e9710ed217579 not found: ID does not exist"
Sep 08 00:29:29.020141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.020119    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:29:29.025882 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.025862    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c6a703-openshift-default-5c6f4c846b-dr72d"]
Sep 08 00:29:29.774578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:29.774546    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" path="/var/lib/kubelet/pods/e1c90888-4f7d-4b9a-84a9-63bbae312b15/volumes"
Sep 08 00:29:34.581208 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:34.581175    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:29:40.756665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:40.756631    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:29:40.757219 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:40.756886    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy" containerID="cri-o://6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911" gracePeriod=30
Sep 08 00:29:44.373293 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:44.373257    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:29:46.014206 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.014179    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:29:46.076012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.075952    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.075994    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076028    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfgdm\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076046    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076073    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076131    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076163    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076188    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076211    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy\") pod \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\" (UID: \"7db76cc8-36b6-48cb-931a-d2e6e3a58dca\") "
Sep 08 00:29:46.076288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076227    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data" (OuterVolumeSpecName: "istio-data") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076359    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076612    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076631    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076647    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076665    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:29:46.076775 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.076699    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:46.078249 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.078219    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token" (OuterVolumeSpecName: "istio-token") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:46.078544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.078522    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:29:46.078634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.078617    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:29:46.078677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.078631    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm" (OuterVolumeSpecName: "kube-api-access-xfgdm") pod "7db76cc8-36b6-48cb-931a-d2e6e3a58dca" (UID: "7db76cc8-36b6-48cb-931a-d2e6e3a58dca"). InnerVolumeSpecName "kube-api-access-xfgdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:29:46.119855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.119829    2580 generic.go:356] "Generic (PLEG): container finished" podID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerID="6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911" exitCode=0
Sep 08 00:29:46.119942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.119874    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"
Sep 08 00:29:46.119942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.119915    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerDied","Data":"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"}
Sep 08 00:29:46.120022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.119971    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z" event={"ID":"7db76cc8-36b6-48cb-931a-d2e6e3a58dca","Type":"ContainerDied","Data":"4532a0e17e5dc1a538167d29262e7112e181555e081ae9910b6177028db2efe7"}
Sep 08 00:29:46.120022 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.119995    2580 scope.go:117] "RemoveContainer" containerID="6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"
Sep 08 00:29:46.132628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.132607    2580 scope.go:117] "RemoveContainer" containerID="acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"
Sep 08 00:29:46.141500 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.141481    2580 scope.go:117] "RemoveContainer" containerID="6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"
Sep 08 00:29:46.141646 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.141630    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:29:46.141764 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:46.141748    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911\": container with ID starting with 6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911 not found: ID does not exist" containerID="6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"
Sep 08 00:29:46.141841 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.141770    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911"} err="failed to get container status \"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911\": rpc error: code = NotFound desc = could not find container \"6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911\": container with ID starting with 6a4105e70ab2d7a7f6109b9ed9d85f8e1446a72a10cd3868d7595c46efb47911 not found: ID does not exist"
Sep 08 00:29:46.141841 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.141786    2580 scope.go:117] "RemoveContainer" containerID="acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"
Sep 08 00:29:46.142000 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:29:46.141983    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea\": container with ID starting with acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea not found: ID does not exist" containerID="acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"
Sep 08 00:29:46.142043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.142001    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea"} err="failed to get container status \"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea\": rpc error: code = NotFound desc = could not find container \"acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea\": container with ID starting with acfac0966f0d86320cdb73292fd9131d8ee56bea54cefe91c5ba2506aa2944ea not found: ID does not exist"
Sep 08 00:29:46.145851 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.145832    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-e1e91c-openshift-default-6f56d7d448-twv2z"]
Sep 08 00:29:46.177050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177030    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177052    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177061    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177073    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177085    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177093    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfgdm\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-kube-api-access-xfgdm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:46.177136 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:46.177102    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7db76cc8-36b6-48cb-931a-d2e6e3a58dca-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:29:47.777102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:47.777076    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" path="/var/lib/kubelet/pods/7db76cc8-36b6-48cb-931a-d2e6e3a58dca/volumes"
Sep 08 00:29:53.874967 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:53.874933    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:29:58.160174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:58.160135    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:29:59.165396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.165360    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:29:59.872719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.872681    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:29:59.873277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873259    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:29:59.873342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873281    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:29:59.873342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873303    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:29:59.873342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873311    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:29:59.873342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873328    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:29:59.873342 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873337    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873357    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873366    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873389    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873398    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873407    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873417    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="597b914b-daf2-4156-a07d-3daa7dc0df50" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873551    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:29:59.873566 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873565    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.873895 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873576    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:29:59.873895 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.873586    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db76cc8-36b6-48cb-931a-d2e6e3a58dca" containerName="istio-proxy"
Sep 08 00:29:59.881782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.881752    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.884226 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.884199    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-8098ed-openshift-default-dockercfg-gt9m6\""
Sep 08 00:29:59.885947 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.885924    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:29:59.991983 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.991945    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.991990    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992025    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992183 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992092    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992376 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992196    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992376 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992288    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992546 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992380    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992546 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992490    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:29:59.992546 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:29:59.992523    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwfvb\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093103    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093134    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093165    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093253    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093325 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093305    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093403    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093436    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwfvb\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093533 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093511    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093536    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093571    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093624    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093664    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.093929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.093825    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.094049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.094028    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.095705 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.095679    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.095806 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.095706    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.100381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.100358    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.100486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.100401    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwfvb\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb\") pod \"e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") " pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.133942 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.133864    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"]
Sep 08 00:30:00.134495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.134472    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:30:00.134495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.134493    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:30:00.134636 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.134586    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1c90888-4f7d-4b9a-84a9-63bbae312b15" containerName="istio-proxy"
Sep 08 00:30:00.134636 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.134600    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="77cf78ac-0a65-4f93-bf33-472c7320a867" containerName="istio-proxy"
Sep 08 00:30:00.139221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.139198    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"
Sep 08 00:30:00.141772 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.141750    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:30:00.143657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.143633    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"]
Sep 08 00:30:00.153849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.153832    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"
Sep 08 00:30:00.197280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.197252    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:00.449202 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.449181    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"]
Sep 08 00:30:00.450873 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:30:00.450845    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35623e74_a928_44fd_9944_964b79df5bb7.slice/crio-81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc WatchSource:0}: Error finding container 81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc: Status 404 returned error can't find the container with id 81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc
Sep 08 00:30:00.511856 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.511828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:30:00.511932 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:30:00.511852    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2208c322_f899_44ed_8ac1_fcc0e9967a0e.slice/crio-ada007d0a9402d3ccb0fddf8111c67173eaaeb4eb964c184a7e44645b51b3c81 WatchSource:0}: Error finding container ada007d0a9402d3ccb0fddf8111c67173eaaeb4eb964c184a7e44645b51b3c81: Status 404 returned error can't find the container with id ada007d0a9402d3ccb0fddf8111c67173eaaeb4eb964c184a7e44645b51b3c81
Sep 08 00:30:00.519473 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.514425    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:00.519473 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.514595    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:00.519473 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:00.514686    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:01.219181 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.219141    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c" event={"ID":"35623e74-a928-44fd-9944-964b79df5bb7","Type":"ContainerStarted","Data":"3f85efe2b85ab2ed5756c9da4effd319b319081078a23860d37d7d615b57b6fa"}
Sep 08 00:30:01.219620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.219204    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c" event={"ID":"35623e74-a928-44fd-9944-964b79df5bb7","Type":"ContainerStarted","Data":"81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc"}
Sep 08 00:30:01.220782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.220755    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerStarted","Data":"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"}
Sep 08 00:30:01.220887 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.220799    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerStarted","Data":"ada007d0a9402d3ccb0fddf8111c67173eaaeb4eb964c184a7e44645b51b3c81"}
Sep 08 00:30:01.236528 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.236488    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c" podStartSLOduration=1.23647157 podStartE2EDuration="1.23647157s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:01.23343297 +0000 UTC m=+1643.984129827" watchObservedRunningTime="2026-09-08 00:30:01.23647157 +0000 UTC m=+1643.987168413"
Sep 08 00:30:01.251240 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:01.251201    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podStartSLOduration=2.2511895490000002 podStartE2EDuration="2.251189549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:01.248878318 +0000 UTC m=+1643.999575164" watchObservedRunningTime="2026-09-08 00:30:01.251189549 +0000 UTC m=+1644.001886393"
Sep 08 00:30:02.198070 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.198036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:02.202972 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.202949    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:02.229929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.229902    2580 generic.go:356] "Generic (PLEG): container finished" podID="35623e74-a928-44fd-9944-964b79df5bb7" containerID="3f85efe2b85ab2ed5756c9da4effd319b319081078a23860d37d7d615b57b6fa" exitCode=0
Sep 08 00:30:02.230337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.229990    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c" event={"ID":"35623e74-a928-44fd-9944-964b79df5bb7","Type":"ContainerDied","Data":"3f85efe2b85ab2ed5756c9da4effd319b319081078a23860d37d7d615b57b6fa"}
Sep 08 00:30:02.230337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.230324    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:02.231104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:02.231082    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:03.369612 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:03.369589    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"
Sep 08 00:30:04.246396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:04.246358    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c" event={"ID":"35623e74-a928-44fd-9944-964b79df5bb7","Type":"ContainerDied","Data":"81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc"}
Sep 08 00:30:04.246625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:04.246404    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"
Sep 08 00:30:04.246625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:04.246418    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="81e9ea8b54f0a9eaf4143b00da8a281f66f71b1352d84b0a8625df0e172af3fc"
Sep 08 00:30:04.476631 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:04.476593    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:30:13.180021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.179973    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" podUID="339a389f-0ed4-481b-ae1c-f91baf0be307" containerName="main" containerID="cri-o://0610c1d34d13479d2edc75ee04e6087d873fbfc4b0e5efdf4199817a6ffcfd56" gracePeriod=45
Sep 08 00:30:13.312159 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.312132    2580 generic.go:356] "Generic (PLEG): container finished" podID="339a389f-0ed4-481b-ae1c-f91baf0be307" containerID="0610c1d34d13479d2edc75ee04e6087d873fbfc4b0e5efdf4199817a6ffcfd56" exitCode=0
Sep 08 00:30:13.312305 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.312218    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" event={"ID":"339a389f-0ed4-481b-ae1c-f91baf0be307","Type":"ContainerDied","Data":"0610c1d34d13479d2edc75ee04e6087d873fbfc4b0e5efdf4199817a6ffcfd56"}
Sep 08 00:30:13.479610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.479586    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:30:13.611784 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611759    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.611959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611805    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwx9d\" (UniqueName: \"kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.611959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611832    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.611959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611874    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.611959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611929    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.612174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.611982    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home\") pod \"339a389f-0ed4-481b-ae1c-f91baf0be307\" (UID: \"339a389f-0ed4-481b-ae1c-f91baf0be307\") "
Sep 08 00:30:13.612174 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.612012    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:13.612265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.612222    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache" (OuterVolumeSpecName: "model-cache") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:13.612314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.612263    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:13.612314 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.612287    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home" (OuterVolumeSpecName: "home") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:13.614001 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.613975    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d" (OuterVolumeSpecName: "kube-api-access-rwx9d") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "kube-api-access-rwx9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:30:13.614112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.614028    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm" (OuterVolumeSpecName: "dshm") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:13.614112 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.614036    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "339a389f-0ed4-481b-ae1c-f91baf0be307" (UID: "339a389f-0ed4-481b-ae1c-f91baf0be307"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:30:13.713220 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.713200    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/339a389f-0ed4-481b-ae1c-f91baf0be307-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:13.713220 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.713221    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:13.713375 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.713231    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:13.713375 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.713238    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/339a389f-0ed4-481b-ae1c-f91baf0be307-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:13.713375 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:13.713246    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwx9d\" (UniqueName: \"kubernetes.io/projected/339a389f-0ed4-481b-ae1c-f91baf0be307-kube-api-access-rwx9d\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.185884 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.185777    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" podUID="d5d027ae-9502-4ca8-889a-3cff044fdc71" containerName="main" containerID="cri-o://ebd45acf1566cf8a74aaa436f79bb3e2ade84fcdd9cb655a06efeab04b60c1ea" gracePeriod=45
Sep 08 00:30:14.321001 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.320978    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"
Sep 08 00:30:14.321132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.321013    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v" event={"ID":"339a389f-0ed4-481b-ae1c-f91baf0be307","Type":"ContainerDied","Data":"619169af7faa19de3407d98e4ad8cc9c93eb85810d6856ab0a09a7d278978a02"}
Sep 08 00:30:14.321132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.321063    2580 scope.go:117] "RemoveContainer" containerID="0610c1d34d13479d2edc75ee04e6087d873fbfc4b0e5efdf4199817a6ffcfd56"
Sep 08 00:30:14.347196 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.347164    2580 generic.go:356] "Generic (PLEG): container finished" podID="d5d027ae-9502-4ca8-889a-3cff044fdc71" containerID="ebd45acf1566cf8a74aaa436f79bb3e2ade84fcdd9cb655a06efeab04b60c1ea" exitCode=0
Sep 08 00:30:14.347498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.347410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" event={"ID":"d5d027ae-9502-4ca8-889a-3cff044fdc71","Type":"ContainerDied","Data":"ebd45acf1566cf8a74aaa436f79bb3e2ade84fcdd9cb655a06efeab04b60c1ea"}
Sep 08 00:30:14.360056 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.360030    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:30:14.365600 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.365578    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-8978e7/rate-test-model-8978e7-kserve-7b897c99cf-m2f2v"]
Sep 08 00:30:14.486217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.486190    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:30:14.621410 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621378    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.621615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621433    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.621615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621503    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.621615 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621555    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.621798 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621616    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.621798 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.621669    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq6ff\" (UniqueName: \"kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff\") pod \"d5d027ae-9502-4ca8-889a-3cff044fdc71\" (UID: \"d5d027ae-9502-4ca8-889a-3cff044fdc71\") "
Sep 08 00:30:14.622434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.622116    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home" (OuterVolumeSpecName: "home") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:14.622434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.622268    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:14.622434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.622400    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache" (OuterVolumeSpecName: "model-cache") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:14.631964 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.631920    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:30:14.632199 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.632175    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff" (OuterVolumeSpecName: "kube-api-access-vq6ff") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "kube-api-access-vq6ff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:30:14.632602 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.632574    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm" (OuterVolumeSpecName: "dshm") pod "d5d027ae-9502-4ca8-889a-3cff044fdc71" (UID: "d5d027ae-9502-4ca8-889a-3cff044fdc71"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:30:14.723381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723308    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.723381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723343    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq6ff\" (UniqueName: \"kubernetes.io/projected/d5d027ae-9502-4ca8-889a-3cff044fdc71-kube-api-access-vq6ff\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.723381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723359    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.723381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723375    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.723686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723387    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5d027ae-9502-4ca8-889a-3cff044fdc71-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:14.723686 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:14.723399    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5d027ae-9502-4ca8-889a-3cff044fdc71-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:30:15.357399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.357369    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"
Sep 08 00:30:15.357925 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.357371    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr" event={"ID":"d5d027ae-9502-4ca8-889a-3cff044fdc71","Type":"ContainerDied","Data":"60f93d96aa877777e920b8de589aa7211b1fd323085dd81e33566622ac1aaa2a"}
Sep 08 00:30:15.357925 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.357503    2580 scope.go:117] "RemoveContainer" containerID="ebd45acf1566cf8a74aaa436f79bb3e2ade84fcdd9cb655a06efeab04b60c1ea"
Sep 08 00:30:15.383471 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.383403    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:30:15.386272 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.386250    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-b8c8cd/rate-test-model-b8c8cd-kserve-5897f6cf-hqpfr"]
Sep 08 00:30:15.774163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.774129    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="339a389f-0ed4-481b-ae1c-f91baf0be307" path="/var/lib/kubelet/pods/339a389f-0ed4-481b-ae1c-f91baf0be307/volumes"
Sep 08 00:30:15.774557 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:15.774543    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5d027ae-9502-4ca8-889a-3cff044fdc71" path="/var/lib/kubelet/pods/d5d027ae-9502-4ca8-889a-3cff044fdc71/volumes"
Sep 08 00:30:16.683005 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:16.682969    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:30:18.272607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:18.272567    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 00:30:18.273104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:18.272648    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 00:30:20.392131 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.392045    2580 generic.go:356] "Generic (PLEG): container finished" podID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerID="20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a" exitCode=0
Sep 08 00:30:20.392532 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.392121    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerDied","Data":"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"}
Sep 08 00:30:20.392582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.392555    2580 scope.go:117] "RemoveContainer" containerID="20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"
Sep 08 00:30:20.393815 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.393785    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:20.393891 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.393861    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:20.393929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:20.393893    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:21.400143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:21.400111    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerStarted","Data":"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"}
Sep 08 00:30:22.198363 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:22.198328    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:22.198586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:22.198526    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 08 00:30:22.198634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:22.198579    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 08 00:30:23.198214 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:23.198179    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 08 00:30:23.198658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:23.198232    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 08 00:30:24.198130 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:24.198097    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 08 00:30:24.198352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:24.198162    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 08 00:30:25.198507 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:25.198444    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 08 00:30:25.198981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:25.198532    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 08 00:30:26.198519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:26.198477    2580 patch_prober.go:28] interesting pod/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused" start-of-body=
Sep 08 00:30:26.199009 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:26.198551    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.99:15021/healthz/ready\": dial tcp 10.132.0.99:15021: connect: connection refused"
Sep 08 00:30:27.201977 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:27.201946    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:27.202389 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:27.202334    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:27.203126 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:27.203108    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:30:29.043956 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.043920    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:30:29.044418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044401    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35623e74-a928-44fd-9944-964b79df5bb7" containerName="cleanup"
Sep 08 00:30:29.044418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044420    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="35623e74-a928-44fd-9944-964b79df5bb7" containerName="cleanup"
Sep 08 00:30:29.044575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044432    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5d027ae-9502-4ca8-889a-3cff044fdc71" containerName="main"
Sep 08 00:30:29.044575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044437    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5d027ae-9502-4ca8-889a-3cff044fdc71" containerName="main"
Sep 08 00:30:29.044575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044483    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="339a389f-0ed4-481b-ae1c-f91baf0be307" containerName="main"
Sep 08 00:30:29.044575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044493    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="339a389f-0ed4-481b-ae1c-f91baf0be307" containerName="main"
Sep 08 00:30:29.044719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044596    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="35623e74-a928-44fd-9944-964b79df5bb7" containerName="cleanup"
Sep 08 00:30:29.044719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044610    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5d027ae-9502-4ca8-889a-3cff044fdc71" containerName="main"
Sep 08 00:30:29.044719 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.044623    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="339a389f-0ed4-481b-ae1c-f91baf0be307" containerName="main"
Sep 08 00:30:29.048105 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.048084    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.050190 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.050170    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-4d2f00-openshift-default-dockercfg-4nsbv\""
Sep 08 00:30:29.059797 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.059774    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:30:29.178040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.177999    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178046    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178126    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178165    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178219    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178298    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178325    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178350    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.178553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.178438    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279434 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279404    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279482    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279513    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279534    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279568    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279625 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279618    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279649    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279679    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.279904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279718    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.280052 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.279949    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.280116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.280054    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.280116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.280108    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.280351 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.280320    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.280480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.280371    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.281786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.281762    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.282160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.282143    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.287237 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.287208    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.287921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.287900    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j\") pod \"e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") " pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.359258 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.359181    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:29.636218 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.636188    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:30:29.636920 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:30:29.636892    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1514452_019a_47e7_adba_889f1bbf976d.slice/crio-a6d89f07bd00addc7c3596693d5b37433d9f6125933048bc1a8da8612d79cca5 WatchSource:0}: Error finding container a6d89f07bd00addc7c3596693d5b37433d9f6125933048bc1a8da8612d79cca5: Status 404 returned error can't find the container with id a6d89f07bd00addc7c3596693d5b37433d9f6125933048bc1a8da8612d79cca5
Sep 08 00:30:29.639423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.639376    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:29.639531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.639499    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:29.639583 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:29.639538    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:30.465787 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:30.465751    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerStarted","Data":"b9574a8d595cc6e12a7c5262b7ab45bdf51cb9e810a7eadbc5033e0a320fdd52"}
Sep 08 00:30:30.466149 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:30.465822    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerStarted","Data":"a6d89f07bd00addc7c3596693d5b37433d9f6125933048bc1a8da8612d79cca5"}
Sep 08 00:30:30.484364 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:30.484313    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podStartSLOduration=1.484294623 podStartE2EDuration="1.484294623s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:30:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:30:30.482598326 +0000 UTC m=+1673.233295197" watchObservedRunningTime="2026-09-08 00:30:30.484294623 +0000 UTC m=+1673.234991467"
Sep 08 00:30:31.359928 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:31.359891    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:31.364981 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:31.364959    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:31.472843 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:31.472815    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:31.473687 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:31.473671    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:38.239931 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:38.239902    2580 scope.go:117] "RemoveContainer" containerID="83873d239861a301ff82f0dbed022e7f8477b264bc6b0dce6edcda46344dae8a"
Sep 08 00:30:38.251016 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:38.250992    2580 scope.go:117] "RemoveContainer" containerID="f59f785381ed8b48c1fd5a5cf7ff562ff9af44de3a8212f49841cb5d45e35799"
Sep 08 00:30:38.259373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:38.259356    2580 scope.go:117] "RemoveContainer" containerID="d738cfcb9edfe566a1e20a3d734cdfbf3a9017251729493f3ff18dbb9180a2e5"
Sep 08 00:30:40.267248 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:40.267213    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:30:50.605177 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.605143    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1514452-019a-47e7-adba-889f1bbf976d" containerID="b9574a8d595cc6e12a7c5262b7ab45bdf51cb9e810a7eadbc5033e0a320fdd52" exitCode=0
Sep 08 00:30:50.605586 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.605219    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerDied","Data":"b9574a8d595cc6e12a7c5262b7ab45bdf51cb9e810a7eadbc5033e0a320fdd52"}
Sep 08 00:30:50.605664 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.605646    2580 scope.go:117] "RemoveContainer" containerID="b9574a8d595cc6e12a7c5262b7ab45bdf51cb9e810a7eadbc5033e0a320fdd52"
Sep 08 00:30:50.606798 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.606757    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:50.606858 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.606843    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:50.606900 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:50.606884    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:30:51.618135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:51.618102    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerStarted","Data":"38d852e68531641715c022b56c27487068707842cc279bb7c4b21393df5abb43"}
Sep 08 00:30:52.359394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:52.359356    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:52.359620 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:52.359574    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 08 00:30:52.359706 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:52.359621    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 08 00:30:53.360002 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:53.359967    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 08 00:30:53.360409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:53.360017    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 08 00:30:54.359792 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:54.359748    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 08 00:30:54.360046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:54.359827    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 08 00:30:55.360262 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:55.360230    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 08 00:30:55.360675 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:55.360289    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 08 00:30:56.359941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:56.359905    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused" start-of-body=
Sep 08 00:30:56.360144 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:56.359962    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.101:15021/healthz/ready\": dial tcp 10.132.0.101:15021: connect: connection refused"
Sep 08 00:30:57.363693 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:57.363660    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:57.364054 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:57.364030    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:30:57.364578 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:30:57.364562    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:31:08.289874 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.289799    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:31:08.294265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.294240    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.296822 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.296799    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-8098ed\"/\"kube-root-ca.crt\""
Sep 08 00:31:08.296946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.296802    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-8098ed\"/\"default-dockercfg-5b925\""
Sep 08 00:31:08.296946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.296847    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-8098ed\"/\"openshift-service-ca.crt\""
Sep 08 00:31:08.297634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.297616    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-8098ed\"/\"ipp-route-8098ed-kserve-self-signed-certs\""
Sep 08 00:31:08.303594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.303570    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:31:08.430418 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430390    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.430571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430425    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4mrm\" (UniqueName: \"kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.430571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.430658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430573    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.430658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.430658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.430625    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531651 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531614    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531651 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531651    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531958 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531683    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531958 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531789    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531958 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531822    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4mrm\" (UniqueName: \"kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.531958 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.531858    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.532202 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.532158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.532280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.532210    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.532280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.532158    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.534048 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.534026    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.534224 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.534205    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.539441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.539417    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4mrm\" (UniqueName: \"kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm\") pod \"ipp-route-8098ed-kserve-76c8d4795f-6mjzc\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") " pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.606607 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.606557    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:08.878525 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:08.878498    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:31:08.879372 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:31:08.879348    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0950296_3c6c_4ad9_8cfd_9761e534655f.slice/crio-7b49d80ebce4901aa7ac6b7fab736c3872b4f48bb811c2c144a1b559520609c3 WatchSource:0}: Error finding container 7b49d80ebce4901aa7ac6b7fab736c3872b4f48bb811c2c144a1b559520609c3: Status 404 returned error can't find the container with id 7b49d80ebce4901aa7ac6b7fab736c3872b4f48bb811c2c144a1b559520609c3
Sep 08 00:31:09.752525 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:09.752489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" event={"ID":"e0950296-3c6c-4ad9-8cfd-9761e534655f","Type":"ContainerStarted","Data":"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"}
Sep 08 00:31:09.752886 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:09.752533    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" event={"ID":"e0950296-3c6c-4ad9-8cfd-9761e534655f","Type":"ContainerStarted","Data":"7b49d80ebce4901aa7ac6b7fab736c3872b4f48bb811c2c144a1b559520609c3"}
Sep 08 00:31:09.770666 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:09.770620    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" podStartSLOduration=1.770605369 podStartE2EDuration="1.770605369s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:31:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:31:09.769585972 +0000 UTC m=+1712.520282833" watchObservedRunningTime="2026-09-08 00:31:09.770605369 +0000 UTC m=+1712.521302265"
Sep 08 00:31:14.080137 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:14.080102    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:31:18.607343 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:18.607309    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:18.607743 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:18.607355    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:18.620037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:18.620008    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:18.819168 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:18.819137    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:31:30.020716 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:30.020683    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:31:38.126980 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.126939    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:31:38.131339 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.131314    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.133524 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.133500    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-3d0f11-openshift-default-dockercfg-bbgsd\""
Sep 08 00:31:38.143439 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.143416    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:31:38.190502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190474    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190525    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190574    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190607    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190623    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190646    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190674    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190752    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4w9f\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.190837 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.190783    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291300 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291267    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291522 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291343    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291522 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291373    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291522 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291406    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291522 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291441    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291537    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4w9f\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291575    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291636    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291687    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.291773 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291710    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.292044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291775    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.292044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291853    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.292044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.291925    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.292207 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.292177    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.294223 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.294189    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.294565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.294543    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.300347 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.300323    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4w9f\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.300523 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.300439    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token\") pod \"e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") " pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.302288 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.302265    2580 scope.go:117] "RemoveContainer" containerID="0ee3a81ad839be6eee73b2a9a05c5bd067e80963433ca76337f1d7e97d42fd6b"
Sep 08 00:31:38.443681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.443627    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:38.721160 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.721132    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:31:38.722764 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:31:38.722736    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf36c6d67_75f9_4560_b01d_03286e7730ad.slice/crio-ee34fa2193d8729442494d335d09184810d4addf8ce33f21cdc6ee89088584b4 WatchSource:0}: Error finding container ee34fa2193d8729442494d335d09184810d4addf8ce33f21cdc6ee89088584b4: Status 404 returned error can't find the container with id ee34fa2193d8729442494d335d09184810d4addf8ce33f21cdc6ee89088584b4
Sep 08 00:31:38.726032 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.725989    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:31:38.726151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.726076    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:31:38.726151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.726140    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:31:38.933462 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.933427    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerStarted","Data":"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"}
Sep 08 00:31:38.933628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.933502    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerStarted","Data":"ee34fa2193d8729442494d335d09184810d4addf8ce33f21cdc6ee89088584b4"}
Sep 08 00:31:38.955116 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:38.955066    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podStartSLOduration=0.955052846 podStartE2EDuration="955.052846ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:31:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:31:38.952645259 +0000 UTC m=+1741.703342127" watchObservedRunningTime="2026-09-08 00:31:38.955052846 +0000 UTC m=+1741.705749690"
Sep 08 00:31:39.444661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:39.444630    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:39.449460 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:39.449423    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:39.939596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:39.939560    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:39.940323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:39.940305    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:31:50.289331 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:31:50.289298    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:32:02.091285 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.091252    2580 generic.go:356] "Generic (PLEG): container finished" podID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerID="98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b" exitCode=0
Sep 08 00:32:02.091734 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.091334    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerDied","Data":"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"}
Sep 08 00:32:02.091793 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.091752    2580 scope.go:117] "RemoveContainer" containerID="98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"
Sep 08 00:32:02.092926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.092889    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:32:02.092992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.092962    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:32:02.093028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:02.092996    2580 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 00:32:03.103702 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:03.103673    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerStarted","Data":"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"}
Sep 08 00:32:03.444235 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:03.444140    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:03.444624 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:03.444537    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 08 00:32:03.444793 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:03.444772    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 08 00:32:04.444301 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:04.444264    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 08 00:32:04.444897 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:04.444864    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 08 00:32:05.444567 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:05.444521    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 08 00:32:05.445144 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:05.445115    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 08 00:32:06.444394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:06.443967    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 08 00:32:06.444394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:06.444028    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 08 00:32:07.444894 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:07.444855    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused" start-of-body=
Sep 08 00:32:07.445496 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:07.445445    2580 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.103:15021/healthz/ready\": dial tcp 10.132.0.103:15021: connect: connection refused"
Sep 08 00:32:08.623601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:08.623566    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:08.624110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:08.623931    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:08.624610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:08.624588    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:17.193327 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:17.193292    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:32:19.545391 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:19.545359    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:32:19.545831 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:19.545613    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" containerID="cri-o://89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0" gracePeriod=30
Sep 08 00:32:23.626155 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:23.626110    2580 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Sep 08 00:32:23.626807 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:23.626181    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:32:24.807442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.807382    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:24.932226 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932192    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932262    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932380 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932344    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932401    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932446    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932479    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:24.932681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932509    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932589    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4w9f\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932565    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data" (OuterVolumeSpecName: "istio-data") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:24.932681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932620    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932681 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932654    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo\") pod \"f36c6d67-75f9-4560-b01d-03286e7730ad\" (UID: \"f36c6d67-75f9-4560-b01d-03286e7730ad\") "
Sep 08 00:32:24.932939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932636    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:24.932939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932758    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:24.932939 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.932850    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:32:24.933098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.933017    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:24.933098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.933036    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f36c6d67-75f9-4560-b01d-03286e7730ad-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:24.933098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.933049    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:24.933098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.933063    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:24.933098 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.933078    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:24.934891 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.934860    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:32:24.935133 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.935102    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token" (OuterVolumeSpecName: "istio-token") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:24.935225 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.935165    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:24.935225 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:24.935177    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f" (OuterVolumeSpecName: "kube-api-access-m4w9f") pod "f36c6d67-75f9-4560-b01d-03286e7730ad" (UID: "f36c6d67-75f9-4560-b01d-03286e7730ad"). InnerVolumeSpecName "kube-api-access-m4w9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:25.033909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.033881    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4w9f\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-kube-api-access-m4w9f\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:25.033909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.033904    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:25.034042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.033913    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:25.034042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.033920    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f36c6d67-75f9-4560-b01d-03286e7730ad-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:25.253386 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.253361    2580 generic.go:356] "Generic (PLEG): container finished" podID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerID="89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0" exitCode=0
Sep 08 00:32:25.253535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.253406    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"
Sep 08 00:32:25.253535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.253418    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerDied","Data":"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"}
Sep 08 00:32:25.253535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.253501    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696" event={"ID":"f36c6d67-75f9-4560-b01d-03286e7730ad","Type":"ContainerDied","Data":"ee34fa2193d8729442494d335d09184810d4addf8ce33f21cdc6ee89088584b4"}
Sep 08 00:32:25.253535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.253523    2580 scope.go:117] "RemoveContainer" containerID="89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"
Sep 08 00:32:25.263740 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.263725    2580 scope.go:117] "RemoveContainer" containerID="98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"
Sep 08 00:32:25.272665 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.272648    2580 scope.go:117] "RemoveContainer" containerID="89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"
Sep 08 00:32:25.272970 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:32:25.272952    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0\": container with ID starting with 89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0 not found: ID does not exist" containerID="89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"
Sep 08 00:32:25.273036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.272978    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0"} err="failed to get container status \"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0\": rpc error: code = NotFound desc = could not find container \"89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0\": container with ID starting with 89df7a941bbe541f3fda3059069dbec29d0c152cee41be11aa4de7a5a38857b0 not found: ID does not exist"
Sep 08 00:32:25.273036 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.272994    2580 scope.go:117] "RemoveContainer" containerID="98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"
Sep 08 00:32:25.273276 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:32:25.273256    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b\": container with ID starting with 98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b not found: ID does not exist" containerID="98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"
Sep 08 00:32:25.273337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.273283    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b"} err="failed to get container status \"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b\": rpc error: code = NotFound desc = could not find container \"98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b\": container with ID starting with 98a7d3c265e2e1b93c4e9b891c57aa89f6304d556c92e12bce5545fe941b8e2b not found: ID does not exist"
Sep 08 00:32:25.277987 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.277959    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:32:25.280634 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.280615    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-3d0f11-openshift-default-54d9d7d66b-49696"]
Sep 08 00:32:25.774390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:25.774361    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" path="/var/lib/kubelet/pods/f36c6d67-75f9-4560-b01d-03286e7730ad/volumes"
Sep 08 00:32:36.088520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:36.088479    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:32:37.943141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:37.943106    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:32:37.949263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:37.949240    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:32:44.397049 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:44.397014    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:32:48.992176 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:48.992141    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:32:59.417169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.417122    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" podUID="e0950296-3c6c-4ad9-8cfd-9761e534655f" containerName="main" containerID="cri-o://cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f" gracePeriod=45
Sep 08 00:32:59.672630 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.672577    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:32:59.737786 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.737760    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4mrm\" (UniqueName: \"kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.737941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.737856    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.737941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.737900    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.737941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.737931    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.738128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.737953    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.738128 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738007    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache\") pod \"e0950296-3c6c-4ad9-8cfd-9761e534655f\" (UID: \"e0950296-3c6c-4ad9-8cfd-9761e534655f\") "
Sep 08 00:32:59.738247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738152    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home" (OuterVolumeSpecName: "home") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:59.738330 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738297    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:59.738405 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738324    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache" (OuterVolumeSpecName: "model-cache") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:59.738479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738427    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:59.738479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738444    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:59.738587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.738487    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:59.740031 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.740006    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm" (OuterVolumeSpecName: "kube-api-access-r4mrm") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "kube-api-access-r4mrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:32:59.740485 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.740439    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm" (OuterVolumeSpecName: "dshm") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:32:59.740485 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.740470    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e0950296-3c6c-4ad9-8cfd-9761e534655f" (UID: "e0950296-3c6c-4ad9-8cfd-9761e534655f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:32:59.839406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.839360    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4mrm\" (UniqueName: \"kubernetes.io/projected/e0950296-3c6c-4ad9-8cfd-9761e534655f-kube-api-access-r4mrm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:59.839406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.839403    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e0950296-3c6c-4ad9-8cfd-9761e534655f-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:32:59.839406 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:32:59.839418    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e0950296-3c6c-4ad9-8cfd-9761e534655f-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:00.470064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.470026    2580 generic.go:356] "Generic (PLEG): container finished" podID="e0950296-3c6c-4ad9-8cfd-9761e534655f" containerID="cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f" exitCode=0
Sep 08 00:33:00.470064 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.470065    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"
Sep 08 00:33:00.470564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.470108    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" event={"ID":"e0950296-3c6c-4ad9-8cfd-9761e534655f","Type":"ContainerDied","Data":"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"}
Sep 08 00:33:00.470564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.470146    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc" event={"ID":"e0950296-3c6c-4ad9-8cfd-9761e534655f","Type":"ContainerDied","Data":"7b49d80ebce4901aa7ac6b7fab736c3872b4f48bb811c2c144a1b559520609c3"}
Sep 08 00:33:00.470564 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.470163    2580 scope.go:117] "RemoveContainer" containerID="cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"
Sep 08 00:33:00.479294 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.479278    2580 scope.go:117] "RemoveContainer" containerID="cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"
Sep 08 00:33:00.479584 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:33:00.479562    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f\": container with ID starting with cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f not found: ID does not exist" containerID="cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"
Sep 08 00:33:00.479689 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.479589    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f"} err="failed to get container status \"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f\": rpc error: code = NotFound desc = could not find container \"cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f\": container with ID starting with cfda57e08c87daae7f6a8e714ea49575fecf7984cbf2014deedc3e3bd60a502f not found: ID does not exist"
Sep 08 00:33:00.494341 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.494321    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:33:00.505862 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:00.502470    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-8098ed/ipp-route-8098ed-kserve-76c8d4795f-6mjzc"]
Sep 08 00:33:01.775589 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:01.775547    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0950296-3c6c-4ad9-8cfd-9761e534655f" path="/var/lib/kubelet/pods/e0950296-3c6c-4ad9-8cfd-9761e534655f/volumes"
Sep 08 00:33:31.797197 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:31.797162    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:33:31.797802 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:31.797421    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy" containerID="cri-o://671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9" gracePeriod=30
Sep 08 00:33:32.168985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.168898    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"]
Sep 08 00:33:32.169318 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169303    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0950296-3c6c-4ad9-8cfd-9761e534655f" containerName="main"
Sep 08 00:33:32.169381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169319    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0950296-3c6c-4ad9-8cfd-9761e534655f" containerName="main"
Sep 08 00:33:32.169381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169329    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:33:32.169381 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169335    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:33:32.169646 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169404    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:33:32.169646 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.169414    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0950296-3c6c-4ad9-8cfd-9761e534655f" containerName="main"
Sep 08 00:33:32.172497 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.172477    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:32.176715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.176690    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-bzrvd\""
Sep 08 00:33:32.177005 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.176987    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:33:32.189499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.189477    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"]
Sep 08 00:33:32.314622 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.314600    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b\" (UID: \"85513b95-7360-4b0b-81fc-d8ba8f8eddcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:32.415171 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.415148    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b\" (UID: \"85513b95-7360-4b0b-81fc-d8ba8f8eddcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:32.415751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.415732    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b\" (UID: \"85513b95-7360-4b0b-81fc-d8ba8f8eddcb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:32.483099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.483071    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:32.785494 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:32.785461    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"]
Sep 08 00:33:32.787039 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:33:32.787011    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85513b95_7360_4b0b_81fc_d8ba8f8eddcb.slice/crio-d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665 WatchSource:0}: Error finding container d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665: Status 404 returned error can't find the container with id d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665
Sep 08 00:33:33.684631 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:33.684598    2580 generic.go:356] "Generic (PLEG): container finished" podID="85513b95-7360-4b0b-81fc-d8ba8f8eddcb" containerID="95c94728cb3dd2361d05e97e084c9d5c254c40dbd4419ed7f6cd4d91c97b1407" exitCode=0
Sep 08 00:33:33.684932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:33.684649    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b" event={"ID":"85513b95-7360-4b0b-81fc-d8ba8f8eddcb","Type":"ContainerDied","Data":"95c94728cb3dd2361d05e97e084c9d5c254c40dbd4419ed7f6cd4d91c97b1407"}
Sep 08 00:33:33.684932 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:33.684694    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b" event={"ID":"85513b95-7360-4b0b-81fc-d8ba8f8eddcb","Type":"ContainerStarted","Data":"d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665"}
Sep 08 00:33:34.828964 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:34.828944    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:34.937679 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:34.937651    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca\") pod \"85513b95-7360-4b0b-81fc-d8ba8f8eddcb\" (UID: \"85513b95-7360-4b0b-81fc-d8ba8f8eddcb\") "
Sep 08 00:33:34.937994 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:34.937971    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "85513b95-7360-4b0b-81fc-d8ba8f8eddcb" (UID: "85513b95-7360-4b0b-81fc-d8ba8f8eddcb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:33:35.038540 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:35.038518    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/85513b95-7360-4b0b-81fc-d8ba8f8eddcb-maas-api-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:35.704678 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:35.704643    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b" event={"ID":"85513b95-7360-4b0b-81fc-d8ba8f8eddcb","Type":"ContainerDied","Data":"d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665"}
Sep 08 00:33:35.704678 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:35.704669    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"
Sep 08 00:33:35.704870 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:35.704729    2580 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0a12c2a5d75fd0f8f6b1f10234999b17b4fa13319e45671d60b2feec8e28665"
Sep 08 00:33:37.063590 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.063513    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:33:37.159222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159179    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159222 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159220    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159253    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159283    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159413    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159481    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159529    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwfvb\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159821 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159587    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.159821 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159651    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:37.159821 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159661    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:33:37.159821 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159687    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy\") pod \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\" (UID: \"2208c322-f899-44ed-8ac1-fcc0e9967a0e\") "
Sep 08 00:33:37.160023 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159819    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:37.160023 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159836    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:37.160023 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.159896    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data" (OuterVolumeSpecName: "istio-data") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:37.160308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.160286    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.160308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.160313    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.160466 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.160326    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.160466 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.160339    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.160466 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.160353    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.161911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.161864    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:33:37.162015 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.161960    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:37.162015 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.161973    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb" (OuterVolumeSpecName: "kube-api-access-jwfvb") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "kube-api-access-jwfvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:33:37.162125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.162110    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token" (OuterVolumeSpecName: "istio-token") pod "2208c322-f899-44ed-8ac1-fcc0e9967a0e" (UID: "2208c322-f899-44ed-8ac1-fcc0e9967a0e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:33:37.261212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.261177    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.261212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.261208    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwfvb\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-kube-api-access-jwfvb\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.261212 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.261219    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.261490 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.261227    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2208c322-f899-44ed-8ac1-fcc0e9967a0e-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:37.719431 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.719402    2580 generic.go:356] "Generic (PLEG): container finished" podID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerID="671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9" exitCode=0
Sep 08 00:33:37.719628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.719471    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"
Sep 08 00:33:37.719628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.719478    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerDied","Data":"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"}
Sep 08 00:33:37.719628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.719586    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j" event={"ID":"2208c322-f899-44ed-8ac1-fcc0e9967a0e","Type":"ContainerDied","Data":"ada007d0a9402d3ccb0fddf8111c67173eaaeb4eb964c184a7e44645b51b3c81"}
Sep 08 00:33:37.719628 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.719610    2580 scope.go:117] "RemoveContainer" containerID="671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"
Sep 08 00:33:37.729920 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.729904    2580 scope.go:117] "RemoveContainer" containerID="20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"
Sep 08 00:33:37.738165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.738149    2580 scope.go:117] "RemoveContainer" containerID="671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"
Sep 08 00:33:37.738409 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:33:37.738392    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9\": container with ID starting with 671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9 not found: ID does not exist" containerID="671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"
Sep 08 00:33:37.738480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.738415    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9"} err="failed to get container status \"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9\": rpc error: code = NotFound desc = could not find container \"671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9\": container with ID starting with 671cd34e053074cc3dc79105e1445af37e53622b317aebb2595914a0996b74e9 not found: ID does not exist"
Sep 08 00:33:37.738480 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.738430    2580 scope.go:117] "RemoveContainer" containerID="20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"
Sep 08 00:33:37.738658 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:33:37.738642    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a\": container with ID starting with 20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a not found: ID does not exist" containerID="20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"
Sep 08 00:33:37.738723 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.738661    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a"} err="failed to get container status \"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a\": rpc error: code = NotFound desc = could not find container \"20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a\": container with ID starting with 20b457043425b8cd5d590c6d585eacf6fc6c3f6d98f6deeca322d7e153cc5b2a not found: ID does not exist"
Sep 08 00:33:37.760667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.760646    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:33:37.773544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:37.773525    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-8098ed-openshift-default-68fbc6b47d-jpk2j"]
Sep 08 00:33:39.773869 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:39.773833    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" path="/var/lib/kubelet/pods/2208c322-f899-44ed-8ac1-fcc0e9967a0e/volumes"
Sep 08 00:33:43.884746 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:43.884712    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"]
Sep 08 00:33:43.892441 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:43.892416    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-4d2f00-67h2b"]
Sep 08 00:33:45.773297 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:45.773260    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85513b95-7360-4b0b-81fc-d8ba8f8eddcb" path="/var/lib/kubelet/pods/85513b95-7360-4b0b-81fc-d8ba8f8eddcb/volumes"
Sep 08 00:33:48.580756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:48.580718    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:33:52.604653 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:52.604617    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:33:52.605063 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:52.604824    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" containerID="cri-o://38d852e68531641715c022b56c27487068707842cc279bb7c4b21393df5abb43" gracePeriod=30
Sep 08 00:33:57.366173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.366139    2580 patch_prober.go:28] interesting pod/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 00:33:57.366562 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.366193    2580 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 00:33:57.836933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.836900    2580 generic.go:356] "Generic (PLEG): container finished" podID="a1514452-019a-47e7-adba-889f1bbf976d" containerID="38d852e68531641715c022b56c27487068707842cc279bb7c4b21393df5abb43" exitCode=0
Sep 08 00:33:57.837076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.836963    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerDied","Data":"38d852e68531641715c022b56c27487068707842cc279bb7c4b21393df5abb43"}
Sep 08 00:33:57.837076 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.837022    2580 scope.go:117] "RemoveContainer" containerID="b9574a8d595cc6e12a7c5262b7ab45bdf51cb9e810a7eadbc5033e0a320fdd52"
Sep 08 00:33:57.872102 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.872044    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:33:57.945813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945788    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.945909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945849    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.945909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945873    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945914    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945938    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945965    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946012 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.945985    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946011    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946104    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token\") pod \"a1514452-019a-47e7-adba-889f1bbf976d\" (UID: \"a1514452-019a-47e7-adba-889f1bbf976d\") "
Sep 08 00:33:57.946215 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946108    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:57.946374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946217    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:57.946374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946302    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data" (OuterVolumeSpecName: "istio-data") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:57.946374 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946358    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:57.946563 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946464    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:33:57.946640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946615    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.946704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946639    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.946704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946652    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a1514452-019a-47e7-adba-889f1bbf976d-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.946704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946666    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.946704 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.946679    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:57.948221 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.948200    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token" (OuterVolumeSpecName: "istio-token") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:33:57.948300 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.948272    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j" (OuterVolumeSpecName: "kube-api-access-l5s5j") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "kube-api-access-l5s5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:33:57.948365 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.948352    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:33:57.948518 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:57.948498    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a1514452-019a-47e7-adba-889f1bbf976d" (UID: "a1514452-019a-47e7-adba-889f1bbf976d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:33:58.047762 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.047739    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5s5j\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-kube-api-access-l5s5j\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:58.047847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.047764    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a1514452-019a-47e7-adba-889f1bbf976d-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:58.047847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.047779    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a1514452-019a-47e7-adba-889f1bbf976d-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:58.047847 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.047790    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a1514452-019a-47e7-adba-889f1bbf976d-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:33:58.844916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.844892    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"
Sep 08 00:33:58.845312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.844933    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8" event={"ID":"a1514452-019a-47e7-adba-889f1bbf976d","Type":"ContainerDied","Data":"a6d89f07bd00addc7c3596693d5b37433d9f6125933048bc1a8da8612d79cca5"}
Sep 08 00:33:58.845312 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.844982    2580 scope.go:117] "RemoveContainer" containerID="38d852e68531641715c022b56c27487068707842cc279bb7c4b21393df5abb43"
Sep 08 00:33:58.879170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.879141    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:33:58.884442 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:58.884419    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-4d2f00-openshift-default-84854b8968-wp5v8"]
Sep 08 00:33:59.774563 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:33:59.774531    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1514452-019a-47e7-adba-889f1bbf976d" path="/var/lib/kubelet/pods/a1514452-019a-47e7-adba-889f1bbf976d/volumes"
Sep 08 00:34:07.355549 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:07.355513    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:34:14.410029 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:14.409998    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:34:14.410409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:14.410233    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy" containerID="cri-o://f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296" gracePeriod=30
Sep 08 00:34:19.676309 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.676285    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:34:19.833966 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.833943    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.833972    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834040    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834057    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834085    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834120 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834149    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834176    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834205    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnmt8\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8\") pod \"6925befe-8934-46e1-b5c9-09dda62fb577\" (UID: \"6925befe-8934-46e1-b5c9-09dda62fb577\") "
Sep 08 00:34:19.834399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834363    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:19.834627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834443    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:19.834627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834473    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:19.834627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834490    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:19.834627 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834620    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.834810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834641    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.834810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834655    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.834810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834671    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6925befe-8934-46e1-b5c9-09dda62fb577-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.834810 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.834673    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data" (OuterVolumeSpecName: "istio-data") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:19.836423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.836398    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token" (OuterVolumeSpecName: "istio-token") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:19.836594 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.836573    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:34:19.836699 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.836681    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:19.836789 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.836768    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8" (OuterVolumeSpecName: "kube-api-access-fnmt8") pod "6925befe-8934-46e1-b5c9-09dda62fb577" (UID: "6925befe-8934-46e1-b5c9-09dda62fb577"). InnerVolumeSpecName "kube-api-access-fnmt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:19.935547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.935521    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.935547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.935543    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6925befe-8934-46e1-b5c9-09dda62fb577-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.935547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.935551    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6925befe-8934-46e1-b5c9-09dda62fb577-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.935769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.935559    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnmt8\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-kube-api-access-fnmt8\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.935769 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.935569    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6925befe-8934-46e1-b5c9-09dda62fb577-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:19.973725 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.973702    2580 generic.go:356] "Generic (PLEG): container finished" podID="6925befe-8934-46e1-b5c9-09dda62fb577" containerID="f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296" exitCode=0
Sep 08 00:34:19.973839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.973743    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"
Sep 08 00:34:19.973839 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.973784    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerDied","Data":"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"}
Sep 08 00:34:19.973924 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.973847    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7" event={"ID":"6925befe-8934-46e1-b5c9-09dda62fb577","Type":"ContainerDied","Data":"07e1ae2e669f2dab9472295e861d97e12f90c03212285d33d0e2bf47446c3bf7"}
Sep 08 00:34:19.973924 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.973877    2580 scope.go:117] "RemoveContainer" containerID="f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"
Sep 08 00:34:19.984874 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.984857    2580 scope.go:117] "RemoveContainer" containerID="c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"
Sep 08 00:34:19.993613 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.993595    2580 scope.go:117] "RemoveContainer" containerID="f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"
Sep 08 00:34:19.993884 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:34:19.993863    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296\": container with ID starting with f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296 not found: ID does not exist" containerID="f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"
Sep 08 00:34:19.993974 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.993894    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296"} err="failed to get container status \"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296\": rpc error: code = NotFound desc = could not find container \"f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296\": container with ID starting with f92da5d1e51a9a508db7dda8200c21326896f7361229099554cee0f9e7854296 not found: ID does not exist"
Sep 08 00:34:19.993974 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.993933    2580 scope.go:117] "RemoveContainer" containerID="c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"
Sep 08 00:34:19.994206 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:34:19.994189    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0\": container with ID starting with c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0 not found: ID does not exist" containerID="c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"
Sep 08 00:34:19.994258 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:19.994212    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0"} err="failed to get container status \"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0\": rpc error: code = NotFound desc = could not find container \"c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0\": container with ID starting with c7ba8fa126569218bcb5e20e14a11e56609fa229bd4b29896d935f449f380cf0 not found: ID does not exist"
Sep 08 00:34:20.004899 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:20.004878    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:34:20.013140 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:20.013121    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-8978e7-openshift-default-bb665dcd4-rlqz7"]
Sep 08 00:34:21.773898 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:21.773865    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" path="/var/lib/kubelet/pods/6925befe-8934-46e1-b5c9-09dda62fb577/volumes"
Sep 08 00:34:25.657978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:25.657943    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"]
Sep 08 00:34:25.661520 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:25.661495    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-b8c8cd-29813790-v6p4c"]
Sep 08 00:34:25.774164 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:25.774130    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35623e74-a928-44fd-9944-964b79df5bb7" path="/var/lib/kubelet/pods/35623e74-a928-44fd-9944-964b79df5bb7/volumes"
Sep 08 00:34:28.108813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:28.108780    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:34:32.892088 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:32.892055    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:34:32.892629 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:32.892284    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy" containerID="cri-o://b18549692a91a293777fec2cd4010f9444e98cc8ca0dcda36a07996a23cb7ca5" gracePeriod=30
Sep 08 00:34:37.592867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:37.592828    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:34:38.094737 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.094705    2580 generic.go:356] "Generic (PLEG): container finished" podID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerID="b18549692a91a293777fec2cd4010f9444e98cc8ca0dcda36a07996a23cb7ca5" exitCode=0
Sep 08 00:34:38.094908 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.094774    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerDied","Data":"b18549692a91a293777fec2cd4010f9444e98cc8ca0dcda36a07996a23cb7ca5"}
Sep 08 00:34:38.094908 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.094847    2580 scope.go:117] "RemoveContainer" containerID="422d4118f0d081a8d4f1ab3ca8fcffd19bed65c550ea13a8a3220e8824fe9806"
Sep 08 00:34:38.144170 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.144139    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:34:38.282040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282001    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282035    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282054    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282082    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282108    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282165    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282228    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282307 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282291    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282322    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:38.282685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282344    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2f6hk\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk\") pod \"ffe760a6-f66d-4a13-9dce-d69221a320e7\" (UID: \"ffe760a6-f66d-4a13-9dce-d69221a320e7\") "
Sep 08 00:34:38.282685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282516    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:38.282685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282645    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:38.282685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282680    2580 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-data\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.282978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282699    2580 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.282978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282723    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:38.282978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.282829    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:34:38.284487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.284433    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 00:34:38.284622 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.284486    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk" (OuterVolumeSpecName: "kube-api-access-2f6hk") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "kube-api-access-2f6hk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:38.284798 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.284779    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:34:38.284883 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.284862    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "ffe760a6-f66d-4a13-9dce-d69221a320e7" (UID: "ffe760a6-f66d-4a13-9dce-d69221a320e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:34:38.366921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.366896    2580 scope.go:117] "RemoveContainer" containerID="e7e1c7f664d7db90142c31e44877c7d012ecf501a9f1c7c6ee4ea13ed63f7c35"
Sep 08 00:34:38.375611 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.375590    2580 scope.go:117] "RemoveContainer" containerID="3dfade777d73b54cab19c9d987597daa8ea2d7b890620ab50a1f251899bedd16"
Sep 08 00:34:38.383357 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383331    2580 scope.go:117] "RemoveContainer" containerID="b18549692a91a293777fec2cd4010f9444e98cc8ca0dcda36a07996a23cb7ca5"
Sep 08 00:34:38.383710 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383689    2580 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-envoy\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.383782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383717    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2f6hk\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-kube-api-access-2f6hk\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.383782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383733    2580 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ffe760a6-f66d-4a13-9dce-d69221a320e7-istiod-ca-cert\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.383782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383745    2580 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-token\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.383782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383758    2580 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ffe760a6-f66d-4a13-9dce-d69221a320e7-istio-podinfo\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.383782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383770    2580 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-credential-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:38.384017 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:38.383782    2580 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ffe760a6-f66d-4a13-9dce-d69221a320e7-workload-socket\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:34:39.100690 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:39.100652    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql" event={"ID":"ffe760a6-f66d-4a13-9dce-d69221a320e7","Type":"ContainerDied","Data":"4de96801e748be80a3ddd0c90ace16f8b7ad2685323e4d03b0646dc0369ead46"}
Sep 08 00:34:39.101166 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:39.100706    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"
Sep 08 00:34:39.139617 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:39.139590    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:34:39.145911 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:39.145885    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-b8c8cd-openshift-default-789b77746b-8w5ql"]
Sep 08 00:34:39.773703 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:34:39.773676    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" path="/var/lib/kubelet/pods/ffe760a6-f66d-4a13-9dce-d69221a320e7/volumes"
Sep 08 00:35:38.422881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:35:38.422808    2580 scope.go:117] "RemoveContainer" containerID="f35d3ea4fd27e9380ad78554ad653766d915e8066d375fac1bdd9773088c1c98"
Sep 08 00:35:59.679876 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:35:59.679837    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:36:22.476936 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:36:22.476901    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:36:29.380145 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:36:29.380103    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:36:36.982037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:36:36.982002    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:36:38.443655 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:36:38.443626    2580 scope.go:117] "RemoveContainer" containerID="3f85efe2b85ab2ed5756c9da4effd319b319081078a23860d37d7d615b57b6fa"
Sep 08 00:36:53.277021 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:36:53.276987    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:37:01.278169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:01.278137    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:37:03.948946 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:03.948915    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:37:03.949359 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:03.949092    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" podUID="b0436f04-5a99-4547-9d9c-8b83f86e3676" containerName="manager" containerID="cri-o://05e3b1ad9c77857dcbab31f0152ac176e2d05812a1fb57c65d883d29ad0a7aad" gracePeriod=10
Sep 08 00:37:05.971726 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:05.971698    2580 generic.go:356] "Generic (PLEG): container finished" podID="b0436f04-5a99-4547-9d9c-8b83f86e3676" containerID="05e3b1ad9c77857dcbab31f0152ac176e2d05812a1fb57c65d883d29ad0a7aad" exitCode=0
Sep 08 00:37:05.972104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:05.971756    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" event={"ID":"b0436f04-5a99-4547-9d9c-8b83f86e3676","Type":"ContainerDied","Data":"05e3b1ad9c77857dcbab31f0152ac176e2d05812a1fb57c65d883d29ad0a7aad"}
Sep 08 00:37:06.107184 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.107162    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:37:06.189997 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.189966    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume\") pod \"b0436f04-5a99-4547-9d9c-8b83f86e3676\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") "
Sep 08 00:37:06.190141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.190028    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vxzz\" (UniqueName: \"kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz\") pod \"b0436f04-5a99-4547-9d9c-8b83f86e3676\" (UID: \"b0436f04-5a99-4547-9d9c-8b83f86e3676\") "
Sep 08 00:37:06.190321 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.190298    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b0436f04-5a99-4547-9d9c-8b83f86e3676" (UID: "b0436f04-5a99-4547-9d9c-8b83f86e3676"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:37:06.191916 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.191894    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz" (OuterVolumeSpecName: "kube-api-access-4vxzz") pod "b0436f04-5a99-4547-9d9c-8b83f86e3676" (UID: "b0436f04-5a99-4547-9d9c-8b83f86e3676"). InnerVolumeSpecName "kube-api-access-4vxzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:37:06.290817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.290751    2580 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b0436f04-5a99-4547-9d9c-8b83f86e3676-extensions-socket-volume\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:37:06.290817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.290774    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vxzz\" (UniqueName: \"kubernetes.io/projected/b0436f04-5a99-4547-9d9c-8b83f86e3676-kube-api-access-4vxzz\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:37:06.978408 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.978374    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"
Sep 08 00:37:06.978867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.978410    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp" event={"ID":"b0436f04-5a99-4547-9d9c-8b83f86e3676","Type":"ContainerDied","Data":"1e7cfea02f0ff01c82bdd9e139faae657809e82ecb0a2e13ef4f316b18730b4e"}
Sep 08 00:37:06.978867 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:06.978487    2580 scope.go:117] "RemoveContainer" containerID="05e3b1ad9c77857dcbab31f0152ac176e2d05812a1fb57c65d883d29ad0a7aad"
Sep 08 00:37:07.001048 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:07.001021    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:37:07.006571 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:07.006547    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-6n6pp"]
Sep 08 00:37:07.773565 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:07.773532    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0436f04-5a99-4547-9d9c-8b83f86e3676" path="/var/lib/kubelet/pods/b0436f04-5a99-4547-9d9c-8b83f86e3676/volumes"
Sep 08 00:37:37.982633 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:37.982607    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:37:37.990308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:37:37.990284    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:38:04.640135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640098    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"]
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640491    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640509    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640519    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640527    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640538    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85513b95-7360-4b0b-81fc-d8ba8f8eddcb" containerName="revoke-keys"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640543    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="85513b95-7360-4b0b-81fc-d8ba8f8eddcb" containerName="revoke-keys"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640552    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640558    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640566    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640571    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640578    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640583    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640597    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640603    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640611    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640616    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640622    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640626    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640635    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0436f04-5a99-4547-9d9c-8b83f86e3676" containerName="manager"
Sep 08 00:38:04.640649 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640640    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0436f04-5a99-4547-9d9c-8b83f86e3676" containerName="manager"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640699    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640707    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640713    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640718    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0436f04-5a99-4547-9d9c-8b83f86e3676" containerName="manager"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640723    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640729    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="85513b95-7360-4b0b-81fc-d8ba8f8eddcb" containerName="revoke-keys"
Sep 08 00:38:04.641308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.640736    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="f36c6d67-75f9-4560-b01d-03286e7730ad" containerName="istio-proxy"
Sep 08 00:38:04.643766 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.643748    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.647169 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.647145    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-lf292\""
Sep 08 00:38:04.675398 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.675372    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"]
Sep 08 00:38:04.696122 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.696089    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/760696e0-3e5c-45b7-b879-c020e2a6c023-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.696291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.696139    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dw8p\" (UniqueName: \"kubernetes.io/projected/760696e0-3e5c-45b7-b879-c020e2a6c023-kube-api-access-4dw8p\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.797428 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.797384    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dw8p\" (UniqueName: \"kubernetes.io/projected/760696e0-3e5c-45b7-b879-c020e2a6c023-kube-api-access-4dw8p\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.797651 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.797546    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/760696e0-3e5c-45b7-b879-c020e2a6c023-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.797899 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.797883    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/760696e0-3e5c-45b7-b879-c020e2a6c023-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.809090 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.809056    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dw8p\" (UniqueName: \"kubernetes.io/projected/760696e0-3e5c-45b7-b879-c020e2a6c023-kube-api-access-4dw8p\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-sqhnn\" (UID: \"760696e0-3e5c-45b7-b879-c020e2a6c023\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:04.953929 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:04.953837    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:05.234190 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:05.234163    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"]
Sep 08 00:38:05.236729 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:38:05.236693    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod760696e0_3e5c_45b7_b879_c020e2a6c023.slice/crio-f69434ec3c1783965442685ef268a42cb027467f2a71eee1ae0dc923b2bde6f7 WatchSource:0}: Error finding container f69434ec3c1783965442685ef268a42cb027467f2a71eee1ae0dc923b2bde6f7: Status 404 returned error can't find the container with id f69434ec3c1783965442685ef268a42cb027467f2a71eee1ae0dc923b2bde6f7
Sep 08 00:38:05.307519 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:05.307489    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn" event={"ID":"760696e0-3e5c-45b7-b879-c020e2a6c023","Type":"ContainerStarted","Data":"f69434ec3c1783965442685ef268a42cb027467f2a71eee1ae0dc923b2bde6f7"}
Sep 08 00:38:06.321050 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:06.321003    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn" event={"ID":"760696e0-3e5c-45b7-b879-c020e2a6c023","Type":"ContainerStarted","Data":"cb0cc5ab1a106bb9344490e10eae7840016c5586b022554e50da7d10f297e9c6"}
Sep 08 00:38:06.321534 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:06.321210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:06.344399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:06.344339    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn" podStartSLOduration=2.344323203 podStartE2EDuration="2.344323203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:06.341707923 +0000 UTC m=+2129.092404768" watchObservedRunningTime="2026-09-08 00:38:06.344323203 +0000 UTC m=+2129.095020047"
Sep 08 00:38:17.329345 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:17.329257    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-sqhnn"
Sep 08 00:38:25.576596 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:25.576554    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:38:32.581360 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:32.581277    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:38:38.789039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:38.788992    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:38:39.280544 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280508    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:38:39.280909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280896    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:39.280955 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280910    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:39.280991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280978    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1514452-019a-47e7-adba-889f1bbf976d" containerName="istio-proxy"
Sep 08 00:38:39.280991 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280988    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="6925befe-8934-46e1-b5c9-09dda62fb577" containerName="istio-proxy"
Sep 08 00:38:39.281071 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.280993    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2208c322-f899-44ed-8ac1-fcc0e9967a0e" containerName="istio-proxy"
Sep 08 00:38:39.281071 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.281000    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffe760a6-f66d-4a13-9dce-d69221a320e7" containerName="istio-proxy"
Sep 08 00:38:39.283817 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.283800    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.285904 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.285883    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-d21df4c8-kserve-self-signed-certs\""
Sep 08 00:38:39.292701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.292672    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:38:39.381150 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381113    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrv89\" (UniqueName: \"kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.381323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381190    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.381323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381218    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.381323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381259    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.381323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381312    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.381527 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.381342    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482701 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482661    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrv89\" (UniqueName: \"kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482728    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482762    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482815    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482854    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.482926 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.482876    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.483310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.483277    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.483310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.483295    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.483498 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.483369    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.485560 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.485524    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.485674 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.485610    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.490409 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.490387    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrv89\" (UniqueName: \"kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89\") pod \"e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") " pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.592899 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.592806    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:39.869508 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:38:39.869442    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b62d1e3_bd87_4b56_bc78_75faec434511.slice/crio-e8429ff14b91f4ea6b57a1754708f5647fa97ae04f558a5f7970f35b2b8e0703 WatchSource:0}: Error finding container e8429ff14b91f4ea6b57a1754708f5647fa97ae04f558a5f7970f35b2b8e0703: Status 404 returned error can't find the container with id e8429ff14b91f4ea6b57a1754708f5647fa97ae04f558a5f7970f35b2b8e0703
Sep 08 00:38:39.869941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:39.869606    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:38:40.527322 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:40.527283    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" event={"ID":"2b62d1e3-bd87-4b56-bc78-75faec434511","Type":"ContainerStarted","Data":"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"}
Sep 08 00:38:40.527322 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:40.527324    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" event={"ID":"2b62d1e3-bd87-4b56-bc78-75faec434511","Type":"ContainerStarted","Data":"e8429ff14b91f4ea6b57a1754708f5647fa97ae04f558a5f7970f35b2b8e0703"}
Sep 08 00:38:40.543486 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:40.543405    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" podStartSLOduration=1.5433860130000001 podStartE2EDuration="1.543386013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:40.543324658 +0000 UTC m=+2163.294021503" watchObservedRunningTime="2026-09-08 00:38:40.543386013 +0000 UTC m=+2163.294082945"
Sep 08 00:38:44.894110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:44.894078    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:38:44.897591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:44.897567    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:44.900733 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:44.900713    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-d21df4c8-kserve-self-signed-certs\""
Sep 08 00:38:44.913065 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:44.913046    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:38:45.025488 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025439    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.025638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025507    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.025638 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025569    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5vd4\" (UniqueName: \"kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.025715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025647    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.025715 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025678    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.025799 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.025775    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127180 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127142    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127218    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127328 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127284    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5vd4\" (UniqueName: \"kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127435 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127435 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127374    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127435 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127426    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127680 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127653    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127704    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.127756 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.127743    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.129959 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.129932    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.130099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.130078    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.135842 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.135817    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5vd4\" (UniqueName: \"kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4\") pod \"e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") " pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.207547 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.207496    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:45.486173 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.486148    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:38:45.487266 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:38:45.487240    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfeff9018_3049_4ebe_b57e_8049ee51ea30.slice/crio-a085de5b37fa6b4f66ecd01207b92baf803946090a6061a19939c6e8aa773090 WatchSource:0}: Error finding container a085de5b37fa6b4f66ecd01207b92baf803946090a6061a19939c6e8aa773090: Status 404 returned error can't find the container with id a085de5b37fa6b4f66ecd01207b92baf803946090a6061a19939c6e8aa773090
Sep 08 00:38:45.563333 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.563307    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" event={"ID":"feff9018-3049-4ebe-b57e-8049ee51ea30","Type":"ContainerStarted","Data":"2385f6236383a328a2bdcdb2292323834c411b5d29ba56580cf6d620a89f6331"}
Sep 08 00:38:45.563484 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.563344    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" event={"ID":"feff9018-3049-4ebe-b57e-8049ee51ea30","Type":"ContainerStarted","Data":"a085de5b37fa6b4f66ecd01207b92baf803946090a6061a19939c6e8aa773090"}
Sep 08 00:38:45.581945 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:45.581893    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" podStartSLOduration=1.5818640240000001 podStartE2EDuration="1.581864024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:38:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:38:45.581808747 +0000 UTC m=+2168.332505604" watchObservedRunningTime="2026-09-08 00:38:45.581864024 +0000 UTC m=+2168.332560872"
Sep 08 00:38:46.786423 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:46.786388    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:38:49.593263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:49.593210    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:49.593263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:49.593276    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:49.606229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:49.606195    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:50.605505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:50.605470    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:38:55.208507 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:55.208447    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:55.208958 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:55.208530    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:55.220661 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:55.220638    2580 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:38:55.636390 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:38:55.636357    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:39:12.723941 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:12.723220    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:39:13.590010 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:13.589979    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:39:14.181366 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:14.181325    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:21.084135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:21.084101    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:26.873724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:26.873690    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:27.745190 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:27.745145    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" podUID="2b62d1e3-bd87-4b56-bc78-75faec434511" containerName="main" containerID="cri-o://38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5" gracePeriod=45
Sep 08 00:39:28.014216 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.014190    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:39:28.070534 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070487    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.070713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070619    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrv89\" (UniqueName: \"kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.070713 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070679    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.070848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070718    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.070848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070755    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.070848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070783    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm\") pod \"2b62d1e3-bd87-4b56-bc78-75faec434511\" (UID: \"2b62d1e3-bd87-4b56-bc78-75faec434511\") "
Sep 08 00:39:28.071323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.070749    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache" (OuterVolumeSpecName: "model-cache") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.071323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.071185    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home" (OuterVolumeSpecName: "home") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.071323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.071295    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.073099 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.073071    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:28.073648 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.073611    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm" (OuterVolumeSpecName: "dshm") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.073763 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.073672    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89" (OuterVolumeSpecName: "kube-api-access-nrv89") pod "2b62d1e3-bd87-4b56-bc78-75faec434511" (UID: "2b62d1e3-bd87-4b56-bc78-75faec434511"). InnerVolumeSpecName "kube-api-access-nrv89". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:39:28.172355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172323    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.172355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172350    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrv89\" (UniqueName: \"kubernetes.io/projected/2b62d1e3-bd87-4b56-bc78-75faec434511-kube-api-access-nrv89\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.172355 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172360    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b62d1e3-bd87-4b56-bc78-75faec434511-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.172598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172368    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.172598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172376    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.172598 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.172382    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b62d1e3-bd87-4b56-bc78-75faec434511-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.609502 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.609465    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" podUID="feff9018-3049-4ebe-b57e-8049ee51ea30" containerName="main" containerID="cri-o://2385f6236383a328a2bdcdb2292323834c411b5d29ba56580cf6d620a89f6331" gracePeriod=45
Sep 08 00:39:28.814992 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.814963    2580 generic.go:356] "Generic (PLEG): container finished" podID="feff9018-3049-4ebe-b57e-8049ee51ea30" containerID="2385f6236383a328a2bdcdb2292323834c411b5d29ba56580cf6d620a89f6331" exitCode=0
Sep 08 00:39:28.815131 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.815040    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" event={"ID":"feff9018-3049-4ebe-b57e-8049ee51ea30","Type":"ContainerDied","Data":"2385f6236383a328a2bdcdb2292323834c411b5d29ba56580cf6d620a89f6331"}
Sep 08 00:39:28.816515 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.816494    2580 generic.go:356] "Generic (PLEG): container finished" podID="2b62d1e3-bd87-4b56-bc78-75faec434511" containerID="38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5" exitCode=0
Sep 08 00:39:28.816614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.816539    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"
Sep 08 00:39:28.816614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.816552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" event={"ID":"2b62d1e3-bd87-4b56-bc78-75faec434511","Type":"ContainerDied","Data":"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"}
Sep 08 00:39:28.816614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.816582    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm" event={"ID":"2b62d1e3-bd87-4b56-bc78-75faec434511","Type":"ContainerDied","Data":"e8429ff14b91f4ea6b57a1754708f5647fa97ae04f558a5f7970f35b2b8e0703"}
Sep 08 00:39:28.816614 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.816598    2580 scope.go:117] "RemoveContainer" containerID="38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"
Sep 08 00:39:28.827394 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.827371    2580 scope.go:117] "RemoveContainer" containerID="38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"
Sep 08 00:39:28.827688 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:39:28.827666    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5\": container with ID starting with 38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5 not found: ID does not exist" containerID="38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"
Sep 08 00:39:28.827770 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.827695    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5"} err="failed to get container status \"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5\": rpc error: code = NotFound desc = could not find container \"38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5\": container with ID starting with 38230a29f6973ad366dd6ad77064318bc5585e3c6a9e4fbf7c0e24a59a15abf5 not found: ID does not exist"
Sep 08 00:39:28.842509 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.840667    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:39:28.850984 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.850959    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-d21df4c8-kserve-7c84c6449f-x2zwm"]
Sep 08 00:39:28.862399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.862354    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:39:28.979667 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979643    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.979805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979674    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.979805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979694    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.979805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979734    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.979805 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979785    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5vd4\" (UniqueName: \"kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.980028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979817    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm\") pod \"feff9018-3049-4ebe-b57e-8049ee51ea30\" (UID: \"feff9018-3049-4ebe-b57e-8049ee51ea30\") "
Sep 08 00:39:28.980028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979944    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.980028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979958    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home" (OuterVolumeSpecName: "home") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.980028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.979998    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache" (OuterVolumeSpecName: "model-cache") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.980233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.980078    2580 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-home\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.980233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.980094    2580 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-tmp-dir\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.980233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.980106    2580 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-model-cache\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:28.981850 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.981825    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm" (OuterVolumeSpecName: "dshm") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 00:39:28.982032 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.982009    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:28.982135 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:28.982035    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4" (OuterVolumeSpecName: "kube-api-access-k5vd4") pod "feff9018-3049-4ebe-b57e-8049ee51ea30" (UID: "feff9018-3049-4ebe-b57e-8049ee51ea30"). InnerVolumeSpecName "kube-api-access-k5vd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:39:29.080608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.080584    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5vd4\" (UniqueName: \"kubernetes.io/projected/feff9018-3049-4ebe-b57e-8049ee51ea30-kube-api-access-k5vd4\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:29.080608 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.080606    2580 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/feff9018-3049-4ebe-b57e-8049ee51ea30-dshm\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:29.080921 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.080615    2580 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/feff9018-3049-4ebe-b57e-8049ee51ea30-tls-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:29.773280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.773247    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b62d1e3-bd87-4b56-bc78-75faec434511" path="/var/lib/kubelet/pods/2b62d1e3-bd87-4b56-bc78-75faec434511/volumes"
Sep 08 00:39:29.824414 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.824387    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz" event={"ID":"feff9018-3049-4ebe-b57e-8049ee51ea30","Type":"ContainerDied","Data":"a085de5b37fa6b4f66ecd01207b92baf803946090a6061a19939c6e8aa773090"}
Sep 08 00:39:29.824535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.824415    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"
Sep 08 00:39:29.824535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.824436    2580 scope.go:117] "RemoveContainer" containerID="2385f6236383a328a2bdcdb2292323834c411b5d29ba56580cf6d620a89f6331"
Sep 08 00:39:29.841495 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.841472    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:39:29.844816 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:29.844796    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-d21df4c8-kserve-84b9555f9f-4dxxz"]
Sep 08 00:39:31.776104 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:31.776071    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feff9018-3049-4ebe-b57e-8049ee51ea30" path="/var/lib/kubelet/pods/feff9018-3049-4ebe-b57e-8049ee51ea30/volumes"
Sep 08 00:39:34.452830 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.452798    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:34.453198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453157    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feff9018-3049-4ebe-b57e-8049ee51ea30" containerName="main"
Sep 08 00:39:34.453198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453168    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="feff9018-3049-4ebe-b57e-8049ee51ea30" containerName="main"
Sep 08 00:39:34.453198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453185    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b62d1e3-bd87-4b56-bc78-75faec434511" containerName="main"
Sep 08 00:39:34.453198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453191    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b62d1e3-bd87-4b56-bc78-75faec434511" containerName="main"
Sep 08 00:39:34.456510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453805    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="feff9018-3049-4ebe-b57e-8049ee51ea30" containerName="main"
Sep 08 00:39:34.456510 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.453835    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b62d1e3-bd87-4b56-bc78-75faec434511" containerName="main"
Sep 08 00:39:34.460433 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.460407    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.463782 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.463759    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-fctqx\""
Sep 08 00:39:34.463922 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.463758    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 00:39:34.464604 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.464580    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 00:39:34.464714 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.464664    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 00:39:34.464848 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.464827    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 00:39:34.466252 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.466224    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:34.521736 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.521712    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.521855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.521776    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glqnw\" (UniqueName: \"kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.521855 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.521830    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.521965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.521888    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.623059 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.623037    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.623163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.623075    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.623163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.623115    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.623163 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.623147    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glqnw\" (UniqueName: \"kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.623909 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.623884    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.625551 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.625532    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.625648 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.625564    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.630582 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.630560    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glqnw\" (UniqueName: \"kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw\") pod \"maas-api-7b4c57c69-98hgp\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") " pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.773310 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.773291    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:34.779852 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:34.779833    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:35.049658 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:35.049634    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:35.051384 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:39:35.051356    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09339487_3564_4166_89e0_58b2395c00a5.slice/crio-44e98212e11406880d5e9eb3b2d0d9d3dbdfb55965f37d46572eba2e11772c5a WatchSource:0}: Error finding container 44e98212e11406880d5e9eb3b2d0d9d3dbdfb55965f37d46572eba2e11772c5a: Status 404 returned error can't find the container with id 44e98212e11406880d5e9eb3b2d0d9d3dbdfb55965f37d46572eba2e11772c5a
Sep 08 00:39:35.053039 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:35.053022    2580 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 00:39:35.864779 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:35.864742    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" event={"ID":"09339487-3564-4166-89e0-58b2395c00a5","Type":"ContainerStarted","Data":"44e98212e11406880d5e9eb3b2d0d9d3dbdfb55965f37d46572eba2e11772c5a"}
Sep 08 00:39:36.872053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:36.871944    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" event={"ID":"09339487-3564-4166-89e0-58b2395c00a5","Type":"ContainerStarted","Data":"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"}
Sep 08 00:39:36.872053 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:36.872036    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:36.891370 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:36.891328    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" podStartSLOduration=1.327152773 podStartE2EDuration="2.891312518s" totalImagesPullingTime="1.564159745s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:36.889014428 +0000 UTC m=+2219.639711273" watchObservedRunningTime="2026-09-08 00:39:36.891312518 +0000 UTC m=+2219.642009394"
Sep 08 00:39:38.491265 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:38.491234    2580 scope.go:117] "RemoveContainer" containerID="95c94728cb3dd2361d05e97e084c9d5c254c40dbd4419ed7f6cd4d91c97b1407"
Sep 08 00:39:42.260046 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.260014    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:42.260446 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.260223    2580 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" podUID="09339487-3564-4166-89e0-58b2395c00a5" containerName="maas-api" containerID="cri-o://4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91" gracePeriod=30
Sep 08 00:39:42.265297 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.265274    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:42.298953 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.298929    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"]
Sep 08 00:39:42.302338 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.302321    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.312890 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.312869    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"]
Sep 08 00:39:42.386606 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.386577    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-metrics-certs\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.386752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.386618    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhclc\" (UniqueName: \"kubernetes.io/projected/c5284a33-4374-4e33-ba61-778792846801-kube-api-access-zhclc\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.386752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.386667    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5284a33-4374-4e33-ba61-778792846801-openshift-service-ca\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.386752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.386738    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-maas-api-tls\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.487440 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.487410    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-maas-api-tls\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.487591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.487497    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-metrics-certs\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.487591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.487532    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhclc\" (UniqueName: \"kubernetes.io/projected/c5284a33-4374-4e33-ba61-778792846801-kube-api-access-zhclc\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.487591 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.487569    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5284a33-4374-4e33-ba61-778792846801-openshift-service-ca\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.488154 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.488130    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5284a33-4374-4e33-ba61-778792846801-openshift-service-ca\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.489630 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.489613    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-maas-api-tls\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.489918 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.489897    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5284a33-4374-4e33-ba61-778792846801-metrics-certs\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.495459 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.495422    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhclc\" (UniqueName: \"kubernetes.io/projected/c5284a33-4374-4e33-ba61-778792846801-kube-api-access-zhclc\") pod \"maas-api-86b5f58bbf-r7wfw\" (UID: \"c5284a33-4374-4e33-ba61-778792846801\") " pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.516500 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.516433    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:42.588040 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.588016    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-glqnw\" (UniqueName: \"kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw\") pod \"09339487-3564-4166-89e0-58b2395c00a5\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") "
Sep 08 00:39:42.588141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.588088    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls\") pod \"09339487-3564-4166-89e0-58b2395c00a5\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") "
Sep 08 00:39:42.588141 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.588116    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca\") pod \"09339487-3564-4166-89e0-58b2395c00a5\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") "
Sep 08 00:39:42.588217 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.588147    2580 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs\") pod \"09339487-3564-4166-89e0-58b2395c00a5\" (UID: \"09339487-3564-4166-89e0-58b2395c00a5\") "
Sep 08 00:39:42.588535 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.588504    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "09339487-3564-4166-89e0-58b2395c00a5" (UID: "09339487-3564-4166-89e0-58b2395c00a5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 00:39:42.590165 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.590137    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw" (OuterVolumeSpecName: "kube-api-access-glqnw") pod "09339487-3564-4166-89e0-58b2395c00a5" (UID: "09339487-3564-4166-89e0-58b2395c00a5"). InnerVolumeSpecName "kube-api-access-glqnw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 00:39:42.590280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.590260    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "09339487-3564-4166-89e0-58b2395c00a5" (UID: "09339487-3564-4166-89e0-58b2395c00a5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:42.590324 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.590274    2580 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "09339487-3564-4166-89e0-58b2395c00a5" (UID: "09339487-3564-4166-89e0-58b2395c00a5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 00:39:42.651324 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.651297    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:42.689077 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.689044    2580 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-glqnw\" (UniqueName: \"kubernetes.io/projected/09339487-3564-4166-89e0-58b2395c00a5-kube-api-access-glqnw\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:42.689077 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.689076    2580 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-maas-api-tls\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:42.689291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.689092    2580 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/09339487-3564-4166-89e0-58b2395c00a5-openshift-service-ca\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:42.689291 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.689103    2580 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/09339487-3564-4166-89e0-58b2395c00a5-metrics-certs\") on node \"ip-10-0-135-226.ec2.internal\" DevicePath \"\""
Sep 08 00:39:42.905884 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.905817    2580 generic.go:356] "Generic (PLEG): container finished" podID="09339487-3564-4166-89e0-58b2395c00a5" containerID="4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91" exitCode=0
Sep 08 00:39:42.905884 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.905856    2580 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"
Sep 08 00:39:42.906117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.905896    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" event={"ID":"09339487-3564-4166-89e0-58b2395c00a5","Type":"ContainerDied","Data":"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"}
Sep 08 00:39:42.906117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.905958    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp" event={"ID":"09339487-3564-4166-89e0-58b2395c00a5","Type":"ContainerDied","Data":"44e98212e11406880d5e9eb3b2d0d9d3dbdfb55965f37d46572eba2e11772c5a"}
Sep 08 00:39:42.906117 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.905992    2580 scope.go:117] "RemoveContainer" containerID="4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"
Sep 08 00:39:42.915296 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.915281    2580 scope.go:117] "RemoveContainer" containerID="4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"
Sep 08 00:39:42.915577 ip-10-0-135-226 kubenswrapper[2580]: E0908 00:39:42.915559    2580 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91\": container with ID starting with 4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91 not found: ID does not exist" containerID="4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"
Sep 08 00:39:42.915640 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.915587    2580 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91"} err="failed to get container status \"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91\": rpc error: code = NotFound desc = could not find container \"4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91\": container with ID starting with 4a94d6baac77b80e19b2e7335bf936b67779d0142b2ec83caa34a23f92727d91 not found: ID does not exist"
Sep 08 00:39:42.926331 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.926312    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"]
Sep 08 00:39:42.928239 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:39:42.928212    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5284a33_4374_4e33_ba61_778792846801.slice/crio-e4cc5cfe5b691deab2d5d0d30dece22e4289229b2ad263c45a5b174fa7f4b1e6 WatchSource:0}: Error finding container e4cc5cfe5b691deab2d5d0d30dece22e4289229b2ad263c45a5b174fa7f4b1e6: Status 404 returned error can't find the container with id e4cc5cfe5b691deab2d5d0d30dece22e4289229b2ad263c45a5b174fa7f4b1e6
Sep 08 00:39:42.931043 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.931023    2580 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:42.937290 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:42.937271    2580 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7b4c57c69-98hgp"]
Sep 08 00:39:43.774132 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.774100    2580 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09339487-3564-4166-89e0-58b2395c00a5" path="/var/lib/kubelet/pods/09339487-3564-4166-89e0-58b2395c00a5/volumes"
Sep 08 00:39:43.783352 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.783327    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:43.913672 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.913642    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw" event={"ID":"c5284a33-4374-4e33-ba61-778792846801","Type":"ContainerStarted","Data":"80c3d77e08d9009be8c7938e2809aa4bc201c37227d3b77aadfc666091e6e579"}
Sep 08 00:39:43.913813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.913687    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw" event={"ID":"c5284a33-4374-4e33-ba61-778792846801","Type":"ContainerStarted","Data":"e4cc5cfe5b691deab2d5d0d30dece22e4289229b2ad263c45a5b174fa7f4b1e6"}
Sep 08 00:39:43.913813 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.913716    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:43.933752 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:43.933707    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw" podStartSLOduration=1.635208233 podStartE2EDuration="1.933693655s" totalImagesPullingTime="298.485422ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:39:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:39:43.931963006 +0000 UTC m=+2226.682659864" watchObservedRunningTime="2026-09-08 00:39:43.933693655 +0000 UTC m=+2226.684390500"
Sep 08 00:39:49.924760 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:49.924730    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-86b5f58bbf-r7wfw"
Sep 08 00:39:50.480151 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:50.480120    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:39:56.381881 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:39:56.381842    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:40:03.180660 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:03.180582    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-5bzrh"]
Sep 08 00:40:11.470167 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:11.470139    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w8xl4_9a2f3a36-d03a-4882-a28a-df0e214b90a9/manager/0.log"
Sep 08 00:40:11.590531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:11.590506    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rh4px_33e0f70c-ea3d-42f2-aeec-53ceec2b04b8/manager/0.log"
Sep 08 00:40:12.052233 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:12.052211    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-rd9p8_6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0/copy-manifests/0.log"
Sep 08 00:40:12.070507 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:12.070481    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-rd9p8_6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0/manager/0.log"
Sep 08 00:40:12.731109 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:12.731079    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-86b5f58bbf-r7wfw_c5284a33-4374-4e33-ba61-778792846801/maas-api/0.log"
Sep 08 00:40:12.839250 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:12.839225    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29813775-c224n_40e12df9-2472-492a-9712-69918a9446c8/cleanup/0.log"
Sep 08 00:40:13.951963 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:13.951931    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-4qmrc_43baea63-4ef6-4c96-bdd9-bd23f58c93c4/manager/0.log"
Sep 08 00:40:14.061849 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.061827    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-wdtm7_b188b2b5-0eab-4662-b7bc-30ea39a3d411/manager/0.log"
Sep 08 00:40:14.167093 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.167071    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-psnxp_386d7c9e-71a1-4b92-8ba9-2469c8c31211/kuadrant-console-plugin/0.log"
Sep 08 00:40:14.285204 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.285182    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sqhnn_760696e0-3e5c-45b7-b879-c020e2a6c023/manager/0.log"
Sep 08 00:40:14.406751 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.406724    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5bzrh_1cb4f1e8-65d7-4ece-8d31-137dc0eee8da/limitador/0.log"
Sep 08 00:40:14.531949 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.531930    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-h2ggs_f01b329d-3d8e-460c-b169-1153790ffee8/manager/0.log"
Sep 08 00:40:14.871950 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:14.871924    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x_0d515462-77ef-49b9-913a-2e8022f38b37/istio-proxy/0.log"
Sep 08 00:40:15.215399 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:15.215371    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-rvmfw_23d0a6c1-5d40-4329-b37d-7ca6cfd9f540/kube-auth-proxy/0.log"
Sep 08 00:40:15.332610 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:15.332582    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/1.log"
Sep 08 00:40:15.667985 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:15.667914    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4ff449fb-rc7hw_ba4d08ce-90e0-452c-b2cb-abf00f6edbd3/router/0.log"
Sep 08 00:40:16.133753 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:16.133724    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qbd4t_7e4f2456-5f8e-4698-be83-b6deecbbf4b6/main/0.log"
Sep 08 00:40:21.858961 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.858929    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsrk2/must-gather-lmxm7"]
Sep 08 00:40:21.859320 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.859306    2580 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09339487-3564-4166-89e0-58b2395c00a5" containerName="maas-api"
Sep 08 00:40:21.859320 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.859318    2580 state_mem.go:107] "Deleted CPUSet assignment" podUID="09339487-3564-4166-89e0-58b2395c00a5" containerName="maas-api"
Sep 08 00:40:21.859412 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.859401    2580 memory_manager.go:368] "RemoveStaleState removing state" podUID="09339487-3564-4166-89e0-58b2395c00a5" containerName="maas-api"
Sep 08 00:40:21.862587 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.862571    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:21.864977 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.864954    2580 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hsrk2\"/\"default-dockercfg-pzcbl\""
Sep 08 00:40:21.865110 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.865056    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsrk2\"/\"openshift-service-ca.crt\""
Sep 08 00:40:21.865274 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.865258    2580 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hsrk2\"/\"kube-root-ca.crt\""
Sep 08 00:40:21.870978 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.870957    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/must-gather-lmxm7"]
Sep 08 00:40:21.897431 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.897404    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbhpl\" (UniqueName: \"kubernetes.io/projected/990f7899-34a4-47c7-aceb-f332f50e6231-kube-api-access-bbhpl\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:21.897572 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.897498    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/990f7899-34a4-47c7-aceb-f332f50e6231-must-gather-output\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:21.997986 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.997964    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/990f7899-34a4-47c7-aceb-f332f50e6231-must-gather-output\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:21.998107 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.998019    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbhpl\" (UniqueName: \"kubernetes.io/projected/990f7899-34a4-47c7-aceb-f332f50e6231-kube-api-access-bbhpl\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:21.998280 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:21.998264    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/990f7899-34a4-47c7-aceb-f332f50e6231-must-gather-output\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:22.006599 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:22.006573    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbhpl\" (UniqueName: \"kubernetes.io/projected/990f7899-34a4-47c7-aceb-f332f50e6231-kube-api-access-bbhpl\") pod \"must-gather-lmxm7\" (UID: \"990f7899-34a4-47c7-aceb-f332f50e6231\") " pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:22.173965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:22.173913    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/must-gather-lmxm7"
Sep 08 00:40:22.444933 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:22.444906    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/must-gather-lmxm7"]
Sep 08 00:40:22.445980 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:40:22.445954    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod990f7899_34a4_47c7_aceb_f332f50e6231.slice/crio-2b53a97a421e47174ecd7c4ca113181e1d689502fba802d8b0e3692f89ea7137 WatchSource:0}: Error finding container 2b53a97a421e47174ecd7c4ca113181e1d689502fba802d8b0e3692f89ea7137: Status 404 returned error can't find the container with id 2b53a97a421e47174ecd7c4ca113181e1d689502fba802d8b0e3692f89ea7137
Sep 08 00:40:23.133505 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:23.133465    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/must-gather-lmxm7" event={"ID":"990f7899-34a4-47c7-aceb-f332f50e6231","Type":"ContainerStarted","Data":"2b53a97a421e47174ecd7c4ca113181e1d689502fba802d8b0e3692f89ea7137"}
Sep 08 00:40:24.143996 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:24.143946    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/must-gather-lmxm7" event={"ID":"990f7899-34a4-47c7-aceb-f332f50e6231","Type":"ContainerStarted","Data":"2dff970c3b479b5f0068e4a4f14fdefc10e9f3f591e50f90d4c8094a589d117e"}
Sep 08 00:40:24.144575 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:24.144552    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/must-gather-lmxm7" event={"ID":"990f7899-34a4-47c7-aceb-f332f50e6231","Type":"ContainerStarted","Data":"62f8c0713ba800a82a3ab9e60378c9a5b3a6027c5d0a5fbf444fbd8329bf9339"}
Sep 08 00:40:24.166416 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:24.166370    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsrk2/must-gather-lmxm7" podStartSLOduration=2.132857308 podStartE2EDuration="3.166356571s" totalImagesPullingTime="1.033499263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 00:40:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:40:24.162004112 +0000 UTC m=+2266.912700957" watchObservedRunningTime="2026-09-08 00:40:24.166356571 +0000 UTC m=+2266.917053415"
Sep 08 00:40:25.032037 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:25.032001    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vz4z5_771a2276-e098-496d-adef-c937a913a59f/global-pull-secret-syncer/0.log"
Sep 08 00:40:25.241998 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:25.241961    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-frm6j_ad1249e1-5fae-4f9e-a014-568cee96101b/konnectivity-agent/0.log"
Sep 08 00:40:25.333424 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:25.333346    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-226.ec2.internal_7a46517dca54415b1b62397a657bd6fb/haproxy/0.log"
Sep 08 00:40:30.459229 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.459197    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-4qmrc_43baea63-4ef6-4c96-bdd9-bd23f58c93c4/manager/0.log"
Sep 08 00:40:30.490244 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.490218    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-wdtm7_b188b2b5-0eab-4662-b7bc-30ea39a3d411/manager/0.log"
Sep 08 00:40:30.525888 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.525726    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-psnxp_386d7c9e-71a1-4b92-8ba9-2469c8c31211/kuadrant-console-plugin/0.log"
Sep 08 00:40:30.577316 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.577281    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-sqhnn_760696e0-3e5c-45b7-b879-c020e2a6c023/manager/0.log"
Sep 08 00:40:30.622843 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.622804    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-5bzrh_1cb4f1e8-65d7-4ece-8d31-137dc0eee8da/limitador/0.log"
Sep 08 00:40:30.705553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:30.705522    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-h2ggs_f01b329d-3d8e-460c-b169-1153790ffee8/manager/0.log"
Sep 08 00:40:32.435384 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:32.435301    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-hwb4w_97b21b46-0b12-49ce-855d-9a41aa30eca6/cluster-monitoring-operator/0.log"
Sep 08 00:40:32.555685 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:32.555647    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6d67c86b5b-5jzz9_362d78f2-7d45-474a-a342-3eef67b58840/metrics-server/0.log"
Sep 08 00:40:32.615268 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:32.615235    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnxgw_f49b369d-4cf4-4cd2-aefa-eb11a0747501/node-exporter/0.log"
Sep 08 00:40:32.640247 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:32.640219    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnxgw_f49b369d-4cf4-4cd2-aefa-eb11a0747501/kube-rbac-proxy/0.log"
Sep 08 00:40:32.663193 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:32.663155    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fnxgw_f49b369d-4cf4-4cd2-aefa-eb11a0747501/init-textfile/0.log"
Sep 08 00:40:34.712487 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.712434    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-c9gh5_a0e09e75-5706-4815-9b0a-1fde1ae647fd/networking-console-plugin/0.log"
Sep 08 00:40:34.822957 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.822917    2580 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"]
Sep 08 00:40:34.831337 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.831305    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:34.836479 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.836429    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"]
Sep 08 00:40:34.931028 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.930989    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-lib-modules\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:34.931323 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.931297    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svcj8\" (UniqueName: \"kubernetes.io/projected/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-kube-api-access-svcj8\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:34.931550 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.931518    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-podres\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:34.931662 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.931562    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-sys\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:34.931662 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:34.931606    2580 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-proc\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033087 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.032995    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svcj8\" (UniqueName: \"kubernetes.io/projected/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-kube-api-access-svcj8\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033365 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033341    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-podres\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033543 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033522    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-sys\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033645 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033612    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-podres\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033645    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-proc\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033711 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033667    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-sys\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033749    2580 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-lib-modules\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033814 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033755    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-proc\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.033965 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.033923    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-lib-modules\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.042561 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.042536    2580 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svcj8\" (UniqueName: \"kubernetes.io/projected/76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce-kube-api-access-svcj8\") pod \"perf-node-gather-daemonset-l2njz\" (UID: \"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce\") " pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.145982 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.145941    2580 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:35.387373 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.387279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/1.log"
Sep 08 00:40:35.396032 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.395941    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-mr28b_0327a736-a2fc-429e-a328-f00d3b243f42/console-operator/2.log"
Sep 08 00:40:35.451824 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.450015    2580 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"]
Sep 08 00:40:35.452722 ip-10-0-135-226 kubenswrapper[2580]: W0908 00:40:35.452691    2580 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod76a85f5b_b6d3_4ab2_ac1b_705b0f0387ce.slice/crio-b58372fbde2eeebb1a8354506d6c8c76ebaeddcbd87dc1a6013d34107fbfced4 WatchSource:0}: Error finding container b58372fbde2eeebb1a8354506d6c8c76ebaeddcbd87dc1a6013d34107fbfced4: Status 404 returned error can't find the container with id b58372fbde2eeebb1a8354506d6c8c76ebaeddcbd87dc1a6013d34107fbfced4
Sep 08 00:40:35.943724 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:35.943696    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-58d5ddb876-pn6j9_e702ff97-e1ac-4011-b6f7-9ecb3f03eea2/console/0.log"
Sep 08 00:40:36.266637 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:36.266594    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz" event={"ID":"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce","Type":"ContainerStarted","Data":"5200bdf070d39195f4f1353a5015bf459700a966ff031a017e422c572b294668"}
Sep 08 00:40:36.266852 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:36.266660    2580 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz" event={"ID":"76a85f5b-b6d3-4ab2-ac1b-705b0f0387ce","Type":"ContainerStarted","Data":"b58372fbde2eeebb1a8354506d6c8c76ebaeddcbd87dc1a6013d34107fbfced4"}
Sep 08 00:40:36.267534 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:36.267509    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:36.286033 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:36.285977    2580 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz" podStartSLOduration=2.285957428 podStartE2EDuration="2.285957428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 00:40:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 00:40:36.284728364 +0000 UTC m=+2279.035425208" watchObservedRunningTime="2026-09-08 00:40:36.285957428 +0000 UTC m=+2279.036654273"
Sep 08 00:40:36.646149 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:36.646070    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-jgjbm_45f25373-dfbf-41b2-bedb-a6c4a929bfdd/volume-data-source-validator/0.log"
Sep 08 00:40:37.764396 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:37.764361    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5mrt_5b7934f1-8ce1-475e-8524-f790689d0867/dns/0.log"
Sep 08 00:40:37.788659 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:37.788622    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5mrt_5b7934f1-8ce1-475e-8524-f790689d0867/kube-rbac-proxy/0.log"
Sep 08 00:40:37.868601 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:37.868571    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qdl9t_89ec8fb0-7e1d-4fae-ae9c-7c768bdfc763/dns-node-resolver/0.log"
Sep 08 00:40:38.431636 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:38.431594    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-pruner-29813760-gjbvs_025ffe90-b36a-460d-88d5-7c9fd0dd0153/image-pruner/0.log"
Sep 08 00:40:38.503499 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:38.503472    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9bswq_7472943a-9a97-40dc-99b9-ed611eafe0a0/node-ca/0.log"
Sep 08 00:40:39.515143 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:39.515111    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x_0d515462-77ef-49b9-913a-2e8022f38b37/istio-proxy/0.log"
Sep 08 00:40:40.090119 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:40.090082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-rvmfw_23d0a6c1-5d40-4329-b37d-7ca6cfd9f540/kube-auth-proxy/0.log"
Sep 08 00:40:40.120277 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:40.120248    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/0.log"
Sep 08 00:40:40.140657 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:40.140627    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/1.log"
Sep 08 00:40:40.253677 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:40.253644    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4ff449fb-rc7hw_ba4d08ce-90e0-452c-b2cb-abf00f6edbd3/router/0.log"
Sep 08 00:40:41.100478 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.100430    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-chcmx_8b7202f7-5128-4cca-8819-56c827353d89/serve-healthcheck-canary/0.log"
Sep 08 00:40:41.632531 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.632501    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fbcft_9c79ec42-bd9b-47ef-a35b-a75046a2d94f/insights-operator/0.log"
Sep 08 00:40:41.633436 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.633399    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-fbcft_9c79ec42-bd9b-47ef-a35b-a75046a2d94f/insights-operator/1.log"
Sep 08 00:40:41.654709 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.654677    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nd8wc_d6d0b840-c1ac-4a67-8efe-a9b2aba631bc/kube-rbac-proxy/0.log"
Sep 08 00:40:41.675097 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.675049    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nd8wc_d6d0b840-c1ac-4a67-8efe-a9b2aba631bc/exporter/0.log"
Sep 08 00:40:41.698014 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:41.697979    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nd8wc_d6d0b840-c1ac-4a67-8efe-a9b2aba631bc/extractor/0.log"
Sep 08 00:40:43.295403 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:43.295377    2580 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hsrk2/perf-node-gather-daemonset-l2njz"
Sep 08 00:40:43.964198 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:43.964164    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-w8xl4_9a2f3a36-d03a-4882-a28a-df0e214b90a9/manager/0.log"
Sep 08 00:40:44.308721 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:44.308631    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-rh4px_33e0f70c-ea3d-42f2-aeec-53ceec2b04b8/manager/0.log"
Sep 08 00:40:44.722621 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:44.722589    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-rd9p8_6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0/manager/0.log"
Sep 08 00:40:44.750653 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:44.750626    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-57cf67b67f-rd9p8_6b1c1bd4-9b9e-4d6c-bbdb-d2b32f1f16d0/copy-manifests/0.log"
Sep 08 00:40:45.048387 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:45.048350    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x_0d515462-77ef-49b9-913a-2e8022f38b37/istio-proxy/0.log"
Sep 08 00:40:45.680738 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:45.680699    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-rvmfw_23d0a6c1-5d40-4329-b37d-7ca6cfd9f540/kube-auth-proxy/0.log"
Sep 08 00:40:45.716553 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:45.716518    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/0.log"
Sep 08 00:40:45.734308 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:45.734279    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/1.log"
Sep 08 00:40:45.821871 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:45.821822    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4ff449fb-rc7hw_ba4d08ce-90e0-452c-b2cb-abf00f6edbd3/router/0.log"
Sep 08 00:40:47.366125 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:47.366089    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-xwp2x_0d515462-77ef-49b9-913a-2e8022f38b37/istio-proxy/0.log"
Sep 08 00:40:47.958185 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:47.958082    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b9b857bf8-rvmfw_23d0a6c1-5d40-4329-b37d-7ca6cfd9f540/kube-auth-proxy/0.log"
Sep 08 00:40:47.989211 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:47.989179    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/0.log"
Sep 08 00:40:48.007042 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:48.007007    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-w4kz7_ccb2526e-f0d0-43b0-a432-b3060a577737/istio-proxy/1.log"
Sep 08 00:40:48.103263 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:48.103233    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7f4ff449fb-rc7hw_ba4d08ce-90e0-452c-b2cb-abf00f6edbd3/router/0.log"
Sep 08 00:40:52.165044 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:52.165004    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-vmwv9_cd61e51b-6dc4-4462-8bbc-3858f532c644/kube-storage-version-migrator-operator/1.log"
Sep 08 00:40:52.166831 ip-10-0-135-226 kubenswrapper[2580]: I0908 00:40:52.166798    2580 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-vmwv9_cd61e51b-6dc4-4462-8bbc-3858f532c644/kube-storage-version-migrator-operator/0.log"