Sep 11 19:16:10.248783 ip-10-0-141-0 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 11 19:16:10.248797 ip-10-0-141-0 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 11 19:16:10.248807 ip-10-0-141-0 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 11 19:16:10.249130 ip-10-0-141-0 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 11 19:16:21.436506 ip-10-0-141-0 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 11 19:16:21.436520 ip-10-0-141-0 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 3d66e62fb7374dc8a0769e210fa27b0e --
Sep 11 19:17:57.358913 ip-10-0-141-0 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 19:17:57.777895 ip-10-0-141-0 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:17:57.777895 ip-10-0-141-0 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 19:17:57.777895 ip-10-0-141-0 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:17:57.777895 ip-10-0-141-0 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 19:17:57.777895 ip-10-0-141-0 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 19:17:57.781145 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.781057    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 19:17:57.785194 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785178    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.785194 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785195    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785200    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785203    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785206    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785210    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785213    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785216    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785219    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785222    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785225    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785228    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785230    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785233    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785236    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785242    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785245    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785248    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785250    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785253    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785256    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.785257 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785258    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785261    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785264    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785267    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785270    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785272    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785275    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785278    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785280    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785283    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785285    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785288    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785291    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785293    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785296    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785298    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785301    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785303    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785306    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785308    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.785755 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785311    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785313    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785316    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785320    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785323    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785327    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785330    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785333    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785335    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785338    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785340    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785343    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785345    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785349    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785354    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785358    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785361    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785363    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785366    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785368    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.786249 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785371    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785374    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785376    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785379    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785382    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785385    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785387    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785392    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785394    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785397    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785400    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785402    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785405    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785408    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785410    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785413    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785415    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785418    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785420    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.786752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785423    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785425    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785428    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785430    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785433    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785436    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785438    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785442    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785445    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785448    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785451    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785454    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785457    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785459    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785462    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785465    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785467    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785470    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.787213 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.785472    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.788191 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788178    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.788191 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788190    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788195    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788197    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788200    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788204    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788207    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788210    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788212    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788215    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788218    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788220    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788223    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788226    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788228    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788231    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788234    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788236    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788239    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788241    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.788250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788244    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788247    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788249    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788252    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788255    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788257    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788260    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788263    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788272    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788274    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788277    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788279    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788282    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788284    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788287    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788289    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788292    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788295    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788298    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.788740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788302    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788306    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788308    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788311    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788314    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788317    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788320    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788322    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788325    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788328    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788331    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788334    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788336    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788338    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788341    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788344    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788347    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788349    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788353    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.789207 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788357    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788360    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788363    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788365    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788368    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788370    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788373    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788375    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788378    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788380    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788383    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788385    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788388    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788391    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788395    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788399    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788401    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788404    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788406    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788409    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.789782 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788411    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788414    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788416    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788419    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788421    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788424    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788427    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788429    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788432    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788435    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788438    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788440    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788443    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788445    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788448    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788450    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788452    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788455    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788457    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788460    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788462    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.790273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788884    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788890    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788894    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788897    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788900    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788904    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788906    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788909    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788912    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788914    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788917    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788919    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788922    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788925    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788928    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788930    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788932    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788937    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788940    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788943    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.790809 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788946    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788949    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788952    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788955    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788958    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788960    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788963    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788966    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788968    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788971    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788973    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788976    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788978    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788981    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788984    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788986    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788988    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788991    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788994    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788996    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.791308 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.788999    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789001    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789004    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789006    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789008    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789011    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789013    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789016    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789018    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789021    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789023    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789029    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789032    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789034    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789037    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789039    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789042    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789044    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789047    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789049    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.791814 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789052    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789055    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789057    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789060    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789062    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789065    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789067    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789070    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789072    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789075    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789078    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789081    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789083    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789086    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789088    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789091    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789093    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789096    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789099    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789102    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.792311 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789104    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789107    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789111    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789117    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789120    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789123    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789126    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789129    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789133    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789136    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789139    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789141    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789144    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789147    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789150    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789152    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789155    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789157    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789160    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.792797 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789225    2562 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789258    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789264    2562 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789269    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789275    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789278    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789282    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789287    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789290    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789293    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789297    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789300    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789304    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789307    2562 flags.go:64] FLAG: --cgroup-root=""
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789310    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789312    2562 flags.go:64] FLAG: --client-ca-file=""
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789316    2562 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789320    2562 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789325    2562 flags.go:64] FLAG: --cluster-domain=""
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789327    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789330    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789334    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789337    2562 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789341    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 19:17:57.793289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789344    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789347    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789350    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789353    2562 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789356    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789359    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789362    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789364    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789368    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789371    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789374    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789377    2562 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789380    2562 flags.go:64] FLAG: --enable-server="true"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789389    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789397    2562 flags.go:64] FLAG: --event-burst="100"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789400    2562 flags.go:64] FLAG: --event-qps="50"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789403    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789406    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789408    2562 flags.go:64] FLAG: --eviction-hard=""
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789412    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789415    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789418    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789421    2562 flags.go:64] FLAG: --eviction-soft=""
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789424    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789428    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 19:17:57.793876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789431    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789434    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789437    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789440    2562 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789442    2562 flags.go:64] FLAG: --feature-gates=""
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789446    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789449    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789452    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789455    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789458    2562 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789461    2562 flags.go:64] FLAG: --help="false"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789464    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-141-0.ec2.internal"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789467    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789470    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789473    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789476    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789479    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789482    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789493    2562 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789497    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789500    2562 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789503    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789507    2562 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789510    2562 flags.go:64] FLAG: --kube-reserved=""
Sep 11 19:17:57.794506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789513    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789516    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789519    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789522    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789525    2562 flags.go:64] FLAG: --lock-file=""
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789527    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789530    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789534    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789539    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789554    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789558    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789560    2562 flags.go:64] FLAG: --logging-format="text"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789563    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789567    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789570    2562 flags.go:64] FLAG: --manifest-url=""
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789573    2562 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789577    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789580    2562 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789584    2562 flags.go:64] FLAG: --max-pods="110"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789587    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789590    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789593    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789597    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789600    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789602    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 19:17:57.795119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789605    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789612    2562 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789615    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789618    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789621    2562 flags.go:64] FLAG: --pod-cidr=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789624    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789630    2562 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789633    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789636    2562 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789639    2562 flags.go:64] FLAG: --port="10250"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789642    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789645    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0be3e8fa602d4f190"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789649    2562 flags.go:64] FLAG: --qos-reserved=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789653    2562 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789656    2562 flags.go:64] FLAG: --register-node="true"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789659    2562 flags.go:64] FLAG: --register-with-taints=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789663    2562 flags.go:64] FLAG: --registry-burst="10"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789666    2562 flags.go:64] FLAG: --registry-qps="5"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789669    2562 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789671    2562 flags.go:64] FLAG: --reserved-memory=""
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789675    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789678    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789681    2562 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789684    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789687    2562 flags.go:64] FLAG: --runonce="false"
Sep 11 19:17:57.795748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789690    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789693    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789696    2562 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789699    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789702    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789705    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789708    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789711    2562 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789714    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789716    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789719    2562 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789722    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789725    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789728    2562 flags.go:64] FLAG: --system-cgroups=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789731    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789736    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789739    2562 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789744    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789749    2562 flags.go:64] FLAG: --tls-min-version=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789751    2562 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789754    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789758    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789761    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789764    2562 flags.go:64] FLAG: --v="2"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789768    2562 flags.go:64] FLAG: --version="false"
Sep 11 19:17:57.796367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789772    2562 flags.go:64] FLAG: --vmodule=""
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789776    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.789780    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789894    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789898    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789901    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789905    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789908    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789911    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789914    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789917    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789920    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789922    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789926    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789930    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789932    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789935    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789938    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789941    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789943    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.797255 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789946    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789949    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789952    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789955    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789958    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789961    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789964    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789966    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789971    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789974    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789977    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789979    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789982    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789985    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789988    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789991    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789994    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789996    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.789999    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790001    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.798146 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790004    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790007    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790010    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790012    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790016    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790020    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790023    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790026    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790029    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790031    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790034    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790037    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790039    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790042    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790045    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790047    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790051    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790054    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790056    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.799013 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790059    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790063    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790065    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790068    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790071    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790074    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790076    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790079    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790081    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790084    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790086    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790089    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790091    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790094    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790097    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790099    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790102    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790105    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790107    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790117    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.799844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790119    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790122    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790125    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790127    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790130    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790132    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790135    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790137    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790141    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790145    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790148    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790151    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790153    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790157    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790160    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790162    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790165    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790167    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790170    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.800749 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790173    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790177    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790180    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.790184    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.791058    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.799401    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.799420    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.799446    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.799454    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799540    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799566    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799571    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799576    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799581    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.801340 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799585    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799589    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799593    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799599    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799603    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799607    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799614    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799623    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799628    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799634    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799638    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799642    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799646    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799650    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799655    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799659    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799663    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799668    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799672    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.801957 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799677    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799681    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799685    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799690    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799694    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799700    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799704    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799708    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799712    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799716    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799721    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799726    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799730    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799734    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799738    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799742    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799746    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799750    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799755    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.802807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799761    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799766    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799771    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799775    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799779    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799784    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799788    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799792    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799796    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799800    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799805    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799809    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799813    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799817    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799824    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799830    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799835    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799840    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799845    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799850    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.803396 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799854    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799858    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799863    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799867    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799872    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799876    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799881    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799886    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799891    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799895    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799900    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799905    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799910    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799914    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799918    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799923    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799928    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799933    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799938    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799942    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.804049 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799947    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799951    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799955    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799960    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799964    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799968    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799972    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799976    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799980    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799985    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799990    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799994    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.799998    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800003    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800007    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.804627 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800012    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.800020    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800197    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800205    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800210    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800215    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800220    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800224    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800229    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800233    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800237    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800242    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800247    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800253    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800258    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 19:17:57.805033 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800263    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800268    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800272    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800279    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800285    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800289    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800294    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800297    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800302    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800306    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800310    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800315    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800319    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800323    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800328    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800332    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800336    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800340    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800344    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800349    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 19:17:57.805417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800353    2562 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800357    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800361    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800366    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800370    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800374    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800378    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800382    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800386    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800390    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800394    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800400    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800404    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800409    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800413    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800417    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800421    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800425    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800431    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 19:17:57.805973 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800438    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800443    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800449    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800454    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800458    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800463    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800468    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800472    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800476    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800480    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800508    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800515    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800520    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800525    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800530    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800534    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800539    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800560    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800565    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800569    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 19:17:57.806487 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800572    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800576    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800581    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800586    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800590    2562 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800595    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800599    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800604    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800608    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800612    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800616    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800620    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800624    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800628    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800633    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800637    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800641    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800646    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800651    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800655    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800659    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 19:17:57.807009 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800663    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800667    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800671    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800676    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800680    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:57.800684    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.800692    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.800870    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.803821    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.804963    2562 server.go:1019] "Starting client certificate rotation"
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.805069    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:17:57.807730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.805106    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 19:17:57.809948 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.809929    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:17:57.813508 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.813467    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 19:17:57.825208 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.825186    2562 log.go:25] "Validated CRI v1 runtime API"
Sep 11 19:17:57.829621 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.829604    2562 log.go:25] "Validated CRI v1 image API"
Sep 11 19:17:57.830507 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.830488    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 19:17:57.834263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.834241    2562 fs.go:135] Filesystem UUIDs: map[7225ce6a-8794-4bf1-bbe5-03e7cc397bf3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 f26fb309-959b-4691-b87c-578cb34697b0:/dev/nvme0n1p4]
Sep 11 19:17:57.834344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.834261    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 19:17:57.836250 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.836227    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:17:57.841044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.840930    2562 manager.go:216] Machine: {Timestamp:2026-09-11 19:17:57.839479663 +0000 UTC m=+0.372535799 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121229 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2431b063388996eddf529a10749b33 SystemUUID:ec2431b0-6338-8996-eddf-529a10749b33 BootID:3d66e62f-b737-4dc8-a076-9e210fa27b0e Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:cc:3e:74:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:cc:3e:74:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:48:c1:64:4a:0d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 19:17:57.841044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.841039    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 19:17:57.841150 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.841120    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 19:17:57.844579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.844554    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 19:17:57.844723 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.844583    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-0.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 19:17:57.846058 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.846047    2562 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 19:17:57.846097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.846061    2562 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 19:17:57.846097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.846069    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:17:57.846917 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.846906    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 19:17:57.848090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.848080    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 19:17:57.852868 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.852853    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:17:57.853113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853092    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 19:17:57.853209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853134    2562 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 19:17:57.853209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853150    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 19:17:57.853209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853171    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 19:17:57.853209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853186    2562 kubelet.go:398] "Adding apiserver pod source"
Sep 11 19:17:57.853209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853200    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 19:17:57.853677 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853663    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:17:57.853732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.853692    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 19:17:57.856367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.856340    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 19:17:57.859385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.859372    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 19:17:57.859434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.859402    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 19:17:57.861462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861446    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 19:17:57.861462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861465    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 19:17:57.861462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861471    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861476    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861492    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861498    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861510    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861515    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861522    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861528    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861537    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 19:17:57.861614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.861555    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 19:17:57.862408 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.862399    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 19:17:57.862408 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.862408    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 19:17:57.865766 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.865744    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-0.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 19:17:57.865845 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.865785    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 19:17:57.865845 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.865820    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 19:17:57.866252 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.866239    2562 server.go:1268] "Started kubelet"
Sep 11 19:17:57.866404 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.866354    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 19:17:57.866483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.866423    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 19:17:57.867106 ip-10-0-141-0 systemd[1]: Started Kubernetes Kubelet.
Sep 11 19:17:57.867224 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.867115    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 19:17:57.867887 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.867869    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 19:17:57.870869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.869902    2562 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 19:17:57.872690 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.871531    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-0.ec2.internal.18d45a561c960e0d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-0.ec2.internal,UID:ip-10-0-141-0.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-0.ec2.internal,},FirstTimestamp:2026-09-11 19:17:57.866212877 +0000 UTC m=+0.399269055,LastTimestamp:2026-09-11 19:17:57.866212877 +0000 UTC m=+0.399269055,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-0.ec2.internal,}"
Sep 11 19:17:57.873666 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.873644    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 19:17:57.874883 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.874865    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 19:17:57.875580 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.875562    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 19:17:57.875734 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.875716    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:57.876316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876298    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876320    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876298    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876334    2562 factory.go:55] Registering systemd factory
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876350    2562 factory.go:223] Registration of the systemd container factory successfully
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876392    2562 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 19:17:57.876405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876402    2562 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 19:17:57.876632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876621    2562 factory.go:153] Registering CRI-O factory
Sep 11 19:17:57.876668 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876636    2562 factory.go:223] Registration of the crio container factory successfully
Sep 11 19:17:57.876696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876688    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 19:17:57.876725 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876706    2562 factory.go:103] Registering Raw factory
Sep 11 19:17:57.876725 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.876718    2562 manager.go:1196] Started watching for new ooms in manager
Sep 11 19:17:57.877037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.877026    2562 manager.go:349] Starting recovery of all containers
Sep 11 19:17:57.877245 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.877214    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-0.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 19:17:57.877390 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.877371    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 19:17:57.887047 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.887021    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4h9mj"
Sep 11 19:17:57.888118 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.888102    2562 manager.go:354] Recovery completed
Sep 11 19:17:57.892822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.892810    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:57.894704 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.894688    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4h9mj"
Sep 11 19:17:57.895055 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895040    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:57.895122 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895072    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:57.895122 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895089    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:57.895709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895688    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 19:17:57.895709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895707    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 19:17:57.895709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895709    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:57.895882 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.895731    2562 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 19:17:57.896502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.896488    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:57.896589 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.896519    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:57.896589 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.896535    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:57.898084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.898073    2562 policy_none.go:49] "None policy: Start"
Sep 11 19:17:57.898134 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.898088    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 19:17:57.898134 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.898099    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 19:17:57.900648 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.900635    2562 policy_none.go:47] "Start"
Sep 11 19:17:57.930156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930140    2562 manager.go:337] "Starting Device Plugin manager"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.930182    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930196    2562 server.go:87] "Starting device plugin registration server"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930529    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930540    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930614    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930674    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.930680    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.931211    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 19:17:57.951885 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.931255    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:57.970609 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.970576    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 19:17:57.971866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.971845    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 19:17:57.971953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.971891    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 19:17:57.971953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.971915    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 19:17:57.972046 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:57.971962    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 19:17:57.974741 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:57.974724    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:17:58.031784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.031665    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:58.033141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.033117    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:58.033248 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.033155    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:58.033248 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.033169    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:58.033248 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.033200    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.050041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.050023    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.050041 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.050048    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-0.ec2.internal\": node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.072081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.072054    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"]
Sep 11 19:17:58.072187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.072118    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:58.075408 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.075387    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:58.075500 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.075419    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:58.075500 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.075429    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:58.076586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.076569    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4cdcfdb8bdbbc4a8ed511bbe2ee055-config\") pod \"kube-apiserver-proxy-ip-10-0-141-0.ec2.internal\" (UID: \"6c4cdcfdb8bdbbc4a8ed511bbe2ee055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.077783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.077768    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:58.077903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.077887    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.077950 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.077917    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:58.079645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079619    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:58.079729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079651    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:58.079729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079619    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:58.079729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079667    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:58.079729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079675    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:58.079729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.079689    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:58.082096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.082066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.082096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.082097    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 19:17:58.082875 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.082856    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 19:17:58.082965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.082885    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 19:17:58.082965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.082895    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeHasSufficientPID"
Sep 11 19:17:58.083447 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.083431    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.111378 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.111346    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-0.ec2.internal\" not found" node="ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.115854 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.115836    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-0.ec2.internal\" not found" node="ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.177271 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.177239    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4cdcfdb8bdbbc4a8ed511bbe2ee055-config\") pod \"kube-apiserver-proxy-ip-10-0-141-0.ec2.internal\" (UID: \"6c4cdcfdb8bdbbc4a8ed511bbe2ee055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.177393 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.177275    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c4cdcfdb8bdbbc4a8ed511bbe2ee055-config\") pod \"kube-apiserver-proxy-ip-10-0-141-0.ec2.internal\" (UID: \"6c4cdcfdb8bdbbc4a8ed511bbe2ee055\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.184394 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.184353    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.277712 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.277682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.277712 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.277711    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.284829 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.284787    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.378514 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.378474    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.378593 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.378517    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.378593 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.378564    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.378593 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.378572    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/87e14e9bfac4f4e67a61226c8ec7e453-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal\" (UID: \"87e14e9bfac4f4e67a61226c8ec7e453\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.385594 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.385578    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.414816 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.414792    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.418608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.418584    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.486345 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.486308    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.586486 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.586412    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.687447 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.687418    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.788053 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.788020    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.804285 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.804255    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 19:17:58.804415 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.804402    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 19:17:58.888245 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:58.888214    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-0.ec2.internal\" not found"
Sep 11 19:17:58.889535 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.889518    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:17:58.900468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.900429    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 19:12:57 +0000 UTC" deadline="2028-06-28 03:45:08.024672226 +0000 UTC"
Sep 11 19:17:58.900468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.900462    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15728h27m9.12421381s"
Sep 11 19:17:58.976036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.976011    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.989088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.989059    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:17:58.990684 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.990663    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal"
Sep 11 19:17:58.996862 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:58.996834    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c4cdcfdb8bdbbc4a8ed511bbe2ee055.slice/crio-9c49b4280d5cbaf3abee2b3712ae0aaf738e7916e47a1e26050cd940e3551c5c WatchSource:0}: Error finding container 9c49b4280d5cbaf3abee2b3712ae0aaf738e7916e47a1e26050cd940e3551c5c: Status 404 returned error can't find the container with id 9c49b4280d5cbaf3abee2b3712ae0aaf738e7916e47a1e26050cd940e3551c5c
Sep 11 19:17:58.997562 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:17:58.997540    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87e14e9bfac4f4e67a61226c8ec7e453.slice/crio-18ee388d44caed53b50bec13cfbdc7afe84032242e11b6c52a7829cf96605ecc WatchSource:0}: Error finding container 18ee388d44caed53b50bec13cfbdc7afe84032242e11b6c52a7829cf96605ecc: Status 404 returned error can't find the container with id 18ee388d44caed53b50bec13cfbdc7afe84032242e11b6c52a7829cf96605ecc
Sep 11 19:17:58.999750 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:58.999735    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 19:17:59.003060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.003044    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:17:59.079793 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.079765    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:17:59.464019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.463986    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:17:59.790958 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.790886    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 19:17:59.855392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.855364    2562 apiserver.go:52] "Watching apiserver"
Sep 11 19:17:59.863299 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.863268    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 19:17:59.865238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.865207    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-wlvf9","openshift-network-diagnostics/network-check-target-zctnk","openshift-network-operator/iptables-alerter-tj7ds","kube-system/global-pull-secret-syncer-j2gh7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8","openshift-image-registry/node-ca-g85c6","openshift-multus/multus-nhn9z","openshift-multus/network-metrics-daemon-tkjf7","openshift-ovn-kubernetes/ovnkube-node-vmggm","kube-system/konnectivity-agent-f65bd","kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal","openshift-cluster-node-tuning-operator/tuned-nbqg6","openshift-dns/node-resolver-5m9j9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal"]
Sep 11 19:17:59.867778 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.867758    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.869934 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.869909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.870973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.870669    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 19:17:59.870973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.870669    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.870973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.870786    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.870973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.870674    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 19:17:59.870973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.870676    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5lz2q\""
Sep 11 19:17:59.872035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.872017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.872866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.872848    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.873095 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.873075    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.873190 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.873170    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qncxq\""
Sep 11 19:17:59.874166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.874146    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.874251 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:59.874212    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:17:59.874728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.874709    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 19:17:59.874728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.874721    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.874884 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.874816    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.874968 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.874950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fg9sr\""
Sep 11 19:17:59.876007 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.875985    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 19:17:59.876426 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.876383    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.878539 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.878520    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.878651 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.878620    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.878943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.878925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 19:17:59.879030 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.878961    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nm75x\""
Sep 11 19:17:59.879030 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.879011    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.880899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.880880    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.881062 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.881044    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.881653 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.881576    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 19:17:59.881653 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.881616    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.881848 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.881834    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7pk2m\""
Sep 11 19:17:59.883274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.883257    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 19:17:59.883274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.883270    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.885076 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.884790    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 19:17:59.885402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.885383    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 19:17:59.885638 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.885621    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 19:17:59.886708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.886035    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.886708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.886093    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:17:59.886708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.886335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 19:17:59.886708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.886465    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.886708 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:59.886327    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:17:59.887125 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.887101    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5hcl8\""
Sep 11 19:17:59.887283 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.887269    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 19:17:59.887429 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.887416    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rznzr\""
Sep 11 19:17:59.888731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-socket-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.888731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-hosts-file\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.888731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888727    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shlfp\" (UniqueName: \"kubernetes.io/projected/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-kube-api-access-shlfp\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.888898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888751    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-dbus\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.888898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-conf-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.888898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888852    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509842df-2ad1-4990-9280-d04a0d9d805b-host-slash\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.888898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xsbl\" (UniqueName: \"kubernetes.io/projected/509842df-2ad1-4990-9280-d04a0d9d805b-kube-api-access-5xsbl\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-cni-binary-copy\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-kubelet-config\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888962    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.888985    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsgsd\" (UniqueName: \"kubernetes.io/projected/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kube-api-access-bsgsd\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889028    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-socket-dir-parent\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889049    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-kubelet\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889148    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-multus-daemon-config\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-etc-kubernetes\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-registration-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-sys-fs\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-host\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-k8s-cni-cncf-io\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889295    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhf4j\" (UniqueName: \"kubernetes.io/projected/84ce9764-735d-42d2-b705-4acea50831eb-kube-api-access-hhf4j\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-tmp-dir\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.889464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889472    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-serviceca\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2s4x\" (UniqueName: \"kubernetes.io/projected/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-kube-api-access-q2s4x\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-cnibin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889540    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-multus-certs\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889599    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-netns\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889630    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-bin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889665    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509842df-2ad1-4990-9280-d04a0d9d805b-iptables-alerter-script\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889685    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-device-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889700    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-system-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-multus\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.890035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.889735    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-hostroot\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.891705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.891690    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-875v9\""
Sep 11 19:17:59.891844 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.891828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:17:59.891932 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:59.891912    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:17:59.891975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.891929    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 19:17:59.892101 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.892089    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 19:17:59.894340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.894322    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.896416 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.896395    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:17:59.897072 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.897007    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 19:17:59.897317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.897205    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 19:17:59.897317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.897256    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gd6md\""
Sep 11 19:17:59.913484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.913465    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zz5pr"
Sep 11 19:17:59.920807 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.920439    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zz5pr"
Sep 11 19:17:59.977021 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.976971    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal" event={"ID":"87e14e9bfac4f4e67a61226c8ec7e453","Type":"ContainerStarted","Data":"18ee388d44caed53b50bec13cfbdc7afe84032242e11b6c52a7829cf96605ecc"}
Sep 11 19:17:59.977304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.977278    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 19:17:59.978145 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.978122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal" event={"ID":"6c4cdcfdb8bdbbc4a8ed511bbe2ee055","Type":"ContainerStarted","Data":"9c49b4280d5cbaf3abee2b3712ae0aaf738e7916e47a1e26050cd940e3551c5c"}
Sep 11 19:17:59.990470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990445    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509842df-2ad1-4990-9280-d04a0d9d805b-iptables-alerter-script\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.990592 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:17:59.990592 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990512    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-slash\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.990592 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-netd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.990730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-cnibin\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.990730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990635    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-conf\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.990730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-var-lib-kubelet\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.990730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990682    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-hosts-file\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.990730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-conf-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990738    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-run\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990758    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509842df-2ad1-4990-9280-d04a0d9d805b-host-slash\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990782    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xsbl\" (UniqueName: \"kubernetes.io/projected/509842df-2ad1-4990-9280-d04a0d9d805b-kube-api-access-5xsbl\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990790    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-hosts-file\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990802    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-cni-binary-copy\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-conf-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/509842df-2ad1-4990-9280-d04a0d9d805b-host-slash\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990904    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.990930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-node-log\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990941    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-log-socket\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990963    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-systemd\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.990990    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-kubelet-config\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991015    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-socket-dir-parent\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-kubelet\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-config\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991125    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-multus-socket-dir-parent\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991138    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-kubelet\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991161    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-kubelet-config\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhc2l\" (UniqueName: \"kubernetes.io/projected/080e8450-92dc-431c-80f9-a549c86f4153-kube-api-access-rhc2l\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-registration-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991295    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-sys-fs\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.991324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991317    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-registration-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991325    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhf4j\" (UniqueName: \"kubernetes.io/projected/84ce9764-735d-42d2-b705-4acea50831eb-kube-api-access-hhf4j\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991371    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-bin\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-sys-fs\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/509842df-2ad1-4990-9280-d04a0d9d805b-iptables-alerter-script\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991388    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-cni-binary-copy\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991481    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-system-cni-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991512    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-tmp-dir\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991533    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-host\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991624    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-etc-tuned\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991698    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-serviceca\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991836    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-etc-selinux\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2s4x\" (UniqueName: \"kubernetes.io/projected/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-kube-api-access-q2s4x\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991919    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-multus-certs\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.992077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-env-overrides\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991989    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-sys\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992011    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-serviceca\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992016    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-netns\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992054    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-systemd-units\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992071    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-var-lib-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992072    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-multus-certs\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992056    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-netns\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992103    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-device-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-system-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-multus\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992221    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-multus\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-device-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.991823    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-tmp-dir\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992268    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-system-cni-dir\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-hostroot\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992349    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23640b3d-6229-4075-b5ad-70f60d7b6a31-agent-certs\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992375    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-socket-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-hostroot\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992402    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shlfp\" (UniqueName: \"kubernetes.io/projected/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-kube-api-access-shlfp\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992427    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-dbus\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-ovn\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992475    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9kgr\" (UniqueName: \"kubernetes.io/projected/fda4714b-dca9-4be3-ad87-61bca71b4fdc-kube-api-access-c9kgr\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992528    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsgsd\" (UniqueName: \"kubernetes.io/projected/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kube-api-access-bsgsd\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-socket-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992529    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a9c3801b-0d71-4655-a745-d78065b1377f-dbus\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:59.992630    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-multus-daemon-config\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:17:59.992686    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:00.49267 +0000 UTC m=+3.025726132 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992707    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-etc-kubernetes\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992733    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-netns\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-etc-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.993840 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.992800    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-etc-kubernetes\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-host\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-k8s-cni-cncf-io\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993414    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-host\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxpmq\" (UniqueName: \"kubernetes.io/projected/bebe2f75-86c3-426b-bc61-3f42723b9093-kube-api-access-fxpmq\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993484    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-modprobe-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993490    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-run-k8s-cni-cncf-io\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-kubernetes\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993534    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/84ce9764-735d-42d2-b705-4acea50831eb-multus-daemon-config\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-tmp\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993606    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-cnibin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-cnibin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.994716 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993754    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23640b3d-6229-4075-b5ad-70f60d7b6a31-konnectivity-ca\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993805    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993849    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gn8c\" (UniqueName: \"kubernetes.io/projected/b4af5044-6d91-4a9e-980a-07695782c0c3-kube-api-access-5gn8c\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovn-node-metrics-cert\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-script-lib\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.993980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysconfig\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-lib-modules\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994140    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-bin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994176    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-kubelet\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994203    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-systemd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:17:59.995450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.994357    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/84ce9764-735d-42d2-b705-4acea50831eb-host-var-lib-cni-bin\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:17:59.998714 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:17:59.998693    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 19:18:00.002909 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.002886    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shlfp\" (UniqueName: \"kubernetes.io/projected/6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36-kube-api-access-shlfp\") pod \"node-resolver-5m9j9\" (UID: \"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36\") " pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:18:00.003016 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.002904    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2s4x\" (UniqueName: \"kubernetes.io/projected/74166b65-c6a3-4163-9c57-ca19bbf3fcb9-kube-api-access-q2s4x\") pod \"node-ca-g85c6\" (UID: \"74166b65-c6a3-4163-9c57-ca19bbf3fcb9\") " pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:18:00.003016 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.002928    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhf4j\" (UniqueName: \"kubernetes.io/projected/84ce9764-735d-42d2-b705-4acea50831eb-kube-api-access-hhf4j\") pod \"multus-nhn9z\" (UID: \"84ce9764-735d-42d2-b705-4acea50831eb\") " pod="openshift-multus/multus-nhn9z"
Sep 11 19:18:00.003132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.003119    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsgsd\" (UniqueName: \"kubernetes.io/projected/4265e0a7-72a7-4370-9a42-2b5cc31252e1-kube-api-access-bsgsd\") pod \"aws-ebs-csi-driver-node-8s4v8\" (UID: \"4265e0a7-72a7-4370-9a42-2b5cc31252e1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:18:00.003341 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.003323    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xsbl\" (UniqueName: \"kubernetes.io/projected/509842df-2ad1-4990-9280-d04a0d9d805b-kube-api-access-5xsbl\") pod \"iptables-alerter-tj7ds\" (UID: \"509842df-2ad1-4990-9280-d04a0d9d805b\") " pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:18:00.095179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:00.095179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095143    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-host\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.095179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-etc-tuned\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.095179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095178    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-env-overrides\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-sys\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-systemd-units\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095249    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-var-lib-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095249    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-host\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095268    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095308    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23640b3d-6229-4075-b5ad-70f60d7b6a31-agent-certs\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095338    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-ovn\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-sys\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095362    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9kgr\" (UniqueName: \"kubernetes.io/projected/fda4714b-dca9-4be3-ad87-61bca71b4fdc-kube-api-access-c9kgr\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095400    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-var-lib-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-netns\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095450    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-netns\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-etc-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095472    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-etc-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.095512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095499    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095567    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095592    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxpmq\" (UniqueName: \"kubernetes.io/projected/bebe2f75-86c3-426b-bc61-3f42723b9093-kube-api-access-fxpmq\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-modprobe-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095644    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-kubernetes\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095664    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-systemd-units\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-tmp\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095713    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23640b3d-6229-4075-b5ad-70f60d7b6a31-konnectivity-ca\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095720    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-env-overrides\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gn8c\" (UniqueName: \"kubernetes.io/projected/b4af5044-6d91-4a9e-980a-07695782c0c3-kube-api-access-5gn8c\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095767    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovn-node-metrics-cert\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095783    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-ovn\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095790    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-script-lib\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095813    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysconfig\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095833    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.096308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-lib-modules\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-run-ovn-kubernetes\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095886    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-kubelet\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-systemd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-slash\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.095999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-netd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096041    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-cnibin\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096065    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-conf\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-var-lib-kubelet\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096114    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-run\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-node-log\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096197    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-log-socket\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-systemd\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096245    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-config\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.097198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhc2l\" (UniqueName: \"kubernetes.io/projected/080e8450-92dc-431c-80f9-a549c86f4153-kube-api-access-rhc2l\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-bin\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096358    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-system-cni-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096439    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-system-cni-dir\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096438    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/23640b3d-6229-4075-b5ad-70f60d7b6a31-konnectivity-ca\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-script-lib\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096512    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-binary-copy\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096573    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-lib-modules\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096651    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-modprobe-d\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096672    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysconfig\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-kubelet\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096739    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-var-lib-kubelet\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-systemd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096785    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bebe2f75-86c3-426b-bc61-3f42723b9093-cnibin\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.096785    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.096864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:00.596846816 +0000 UTC m=+3.129902917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-sysctl-conf\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.096939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-slash\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097058    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-bin\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-run\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097060    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-host-cni-netd\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097291    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-log-socket\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097296    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-node-log\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovnkube-config\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fda4714b-dca9-4be3-ad87-61bca71b4fdc-run-openvswitch\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097352    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-systemd\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097397    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/080e8450-92dc-431c-80f9-a549c86f4153-etc-kubernetes\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097874    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/bebe2f75-86c3-426b-bc61-3f42723b9093-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.097999    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-etc-tuned\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.098199    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/080e8450-92dc-431c-80f9-a549c86f4153-tmp\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.098876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.098582    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fda4714b-dca9-4be3-ad87-61bca71b4fdc-ovn-node-metrics-cert\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.099505 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.099427    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/23640b3d-6229-4075-b5ad-70f60d7b6a31-agent-certs\") pod \"konnectivity-agent-f65bd\" (UID: \"23640b3d-6229-4075-b5ad-70f60d7b6a31\") " pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:00.102329 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.102310    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:00.102442 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.102332    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:00.102442 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.102344    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:00.102442 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.102413    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:00.602396911 +0000 UTC m=+3.135453028 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:00.104125 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.104106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gn8c\" (UniqueName: \"kubernetes.io/projected/b4af5044-6d91-4a9e-980a-07695782c0c3-kube-api-access-5gn8c\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:00.104826 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.104795    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxpmq\" (UniqueName: \"kubernetes.io/projected/bebe2f75-86c3-426b-bc61-3f42723b9093-kube-api-access-fxpmq\") pod \"multus-additional-cni-plugins-wlvf9\" (UID: \"bebe2f75-86c3-426b-bc61-3f42723b9093\") " pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.105484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.105447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9kgr\" (UniqueName: \"kubernetes.io/projected/fda4714b-dca9-4be3-ad87-61bca71b4fdc-kube-api-access-c9kgr\") pod \"ovnkube-node-vmggm\" (UID: \"fda4714b-dca9-4be3-ad87-61bca71b4fdc\") " pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.107966 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.107935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhc2l\" (UniqueName: \"kubernetes.io/projected/080e8450-92dc-431c-80f9-a549c86f4153-kube-api-access-rhc2l\") pod \"tuned-nbqg6\" (UID: \"080e8450-92dc-431c-80f9-a549c86f4153\") " pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.180678 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.180638    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nhn9z"
Sep 11 19:18:00.188316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.188288    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5m9j9"
Sep 11 19:18:00.199244 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.199213    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tj7ds"
Sep 11 19:18:00.203987 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.203970    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8"
Sep 11 19:18:00.211810 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.211785    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-g85c6"
Sep 11 19:18:00.218597 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.218573    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:00.225484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.225465    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wlvf9"
Sep 11 19:18:00.231481 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.231464    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:00.236039 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.236020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbqg6"
Sep 11 19:18:00.499027 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.498945    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:00.499188 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.499093    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:00.499188 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.499158    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:01.499137257 +0000 UTC m=+4.032193359 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:00.599691 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.599652    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:00.599834 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.599795    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:00.599878 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.599860    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:01.599842265 +0000 UTC m=+4.132898364 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:00.700037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.699997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:00.700196 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.700173    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:00.700259 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.700201    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:00.700259 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.700217    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:00.700317 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.700272    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:01.700258726 +0000 UTC m=+4.233314825 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:00.919752 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:00.919718    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84ce9764_735d_42d2_b705_4acea50831eb.slice/crio-1822f938a4fe889c5e5dc9945bffef5c13d29de900805a8cf5155ce7caf8e9e5 WatchSource:0}: Error finding container 1822f938a4fe889c5e5dc9945bffef5c13d29de900805a8cf5155ce7caf8e9e5: Status 404 returned error can't find the container with id 1822f938a4fe889c5e5dc9945bffef5c13d29de900805a8cf5155ce7caf8e9e5
Sep 11 19:18:00.923805 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.923778    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:12:59 +0000 UTC" deadline="2028-05-19 03:00:43.412515906 +0000 UTC"
Sep 11 19:18:00.923805 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.923805    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14767h42m42.488715285s"
Sep 11 19:18:00.927871 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:00.927852    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74166b65_c6a3_4163_9c57_ca19bbf3fcb9.slice/crio-8dffae3d3d95ccfed533b759591301eabb94331e90509978ec358ba95773f77c WatchSource:0}: Error finding container 8dffae3d3d95ccfed533b759591301eabb94331e90509978ec358ba95773f77c: Status 404 returned error can't find the container with id 8dffae3d3d95ccfed533b759591301eabb94331e90509978ec358ba95773f77c
Sep 11 19:18:00.948867 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:00.948845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod509842df_2ad1_4990_9280_d04a0d9d805b.slice/crio-93ed139ff04940c137bb7ca97ef6a1bc50c0597fc34be60de5abe85e782486ca WatchSource:0}: Error finding container 93ed139ff04940c137bb7ca97ef6a1bc50c0597fc34be60de5abe85e782486ca: Status 404 returned error can't find the container with id 93ed139ff04940c137bb7ca97ef6a1bc50c0597fc34be60de5abe85e782486ca
Sep 11 19:18:00.949767 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:00.949744    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbebe2f75_86c3_426b_bc61_3f42723b9093.slice/crio-ddb4af140303dcffcb2be4c83be4455784573c643d66c6cceca6f717ffc6aec9 WatchSource:0}: Error finding container ddb4af140303dcffcb2be4c83be4455784573c643d66c6cceca6f717ffc6aec9: Status 404 returned error can't find the container with id ddb4af140303dcffcb2be4c83be4455784573c643d66c6cceca6f717ffc6aec9
Sep 11 19:18:00.972863 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.972691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:00.972863 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:00.972818    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:00.980959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.980932    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f65bd" event={"ID":"23640b3d-6229-4075-b5ad-70f60d7b6a31","Type":"ContainerStarted","Data":"1fdeba340dcd676b4f7e749c5412e16684716415370414a4f2e7792546e6037d"}
Sep 11 19:18:00.982007 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.981986    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8" event={"ID":"4265e0a7-72a7-4370-9a42-2b5cc31252e1","Type":"ContainerStarted","Data":"825771a856c3595d75acdcc709dfe67c0507a6e71b72d19b6b28f64b3878e7b7"}
Sep 11 19:18:00.983443 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.983421    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbqg6" event={"ID":"080e8450-92dc-431c-80f9-a549c86f4153","Type":"ContainerStarted","Data":"cf409915d8073edb06e92a62989ff54f5068af978686861bd77de1991151ea18"}
Sep 11 19:18:00.984499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.984481    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerStarted","Data":"ddb4af140303dcffcb2be4c83be4455784573c643d66c6cceca6f717ffc6aec9"}
Sep 11 19:18:00.985635 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.985607    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhn9z" event={"ID":"84ce9764-735d-42d2-b705-4acea50831eb","Type":"ContainerStarted","Data":"1822f938a4fe889c5e5dc9945bffef5c13d29de900805a8cf5155ce7caf8e9e5"}
Sep 11 19:18:00.992865 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.992842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m9j9" event={"ID":"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36","Type":"ContainerStarted","Data":"6ed36b30340830c2dfdd826bfddfe4751140c088f97d633f2633b3b7a064d3b0"}
Sep 11 19:18:00.994540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.994511    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"dfb65191bc5d86ae2d751a51af6c8f935b811997afc6496536de23cb28ae1c75"}
Sep 11 19:18:00.997297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.997267    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tj7ds" event={"ID":"509842df-2ad1-4990-9280-d04a0d9d805b","Type":"ContainerStarted","Data":"93ed139ff04940c137bb7ca97ef6a1bc50c0597fc34be60de5abe85e782486ca"}
Sep 11 19:18:00.998463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:00.998442    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g85c6" event={"ID":"74166b65-c6a3-4163-9c57-ca19bbf3fcb9","Type":"ContainerStarted","Data":"8dffae3d3d95ccfed533b759591301eabb94331e90509978ec358ba95773f77c"}
Sep 11 19:18:01.506586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.506457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:01.506746 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.506630    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:01.506746 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.506713    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:03.506690752 +0000 UTC m=+6.039746868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:01.607734 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.607691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:01.607913 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.607897    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:01.607974 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.607961    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:03.607943842 +0000 UTC m=+6.140999943 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:01.708518 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.708480    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:01.708709 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.708686    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:01.708709 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.708707    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:01.708821 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.708721    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:01.708821 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.708784    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:03.708764226 +0000 UTC m=+6.241820339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:01.924295 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.924128    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 19:12:59 +0000 UTC" deadline="2028-04-30 05:33:46.430011384 +0000 UTC"
Sep 11 19:18:01.924295 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.924194    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14314h15m44.505823267s"
Sep 11 19:18:01.976100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.975368    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:01.976100 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.975506    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:01.976100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:01.975936    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:01.976100 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:01.976026    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:02.015321 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:02.015090    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal" event={"ID":"6c4cdcfdb8bdbbc4a8ed511bbe2ee055","Type":"ContainerStarted","Data":"1dac2202ede4998fe5e2ddf518ec55479e724d6ddfed7bf233b2b26f8cba85de"}
Sep 11 19:18:02.030160 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:02.029825    2562 generic.go:356] "Generic (PLEG): container finished" podID="87e14e9bfac4f4e67a61226c8ec7e453" containerID="ff9918d604d7966e89c208f645d325dc58d6cb4781852dcafd5f08751815d37f" exitCode=0
Sep 11 19:18:02.030160 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:02.029877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal" event={"ID":"87e14e9bfac4f4e67a61226c8ec7e453","Type":"ContainerDied","Data":"ff9918d604d7966e89c208f645d325dc58d6cb4781852dcafd5f08751815d37f"}
Sep 11 19:18:02.049682 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:02.049399    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-0.ec2.internal" podStartSLOduration=3.0493690940000002 podStartE2EDuration="3.049369094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:02.03352151 +0000 UTC m=+4.566577632" watchObservedRunningTime="2026-09-11 19:18:02.049369094 +0000 UTC m=+4.582425215"
Sep 11 19:18:02.973579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:02.973003    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:02.973579 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:02.973157    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:03.061147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.061102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal" event={"ID":"87e14e9bfac4f4e67a61226c8ec7e453","Type":"ContainerStarted","Data":"d884ce217b5e1c5e29ae7c8f0f71d991c3e2cd78b7e1f1cee46073eaa4dd85e0"}
Sep 11 19:18:03.525406 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.525103    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:03.525619 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.525523    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:03.525619 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.525604    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:07.525585061 +0000 UTC m=+10.058641166 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:03.626650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.626612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:03.626840 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.626804    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:03.626910 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.626867    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:07.626847727 +0000 UTC m=+10.159903831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:03.727869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.727829    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:03.728056 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.728002    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:03.728056 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.728026    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:03.728162 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.728071    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:03.728162 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.728136    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:07.728116695 +0000 UTC m=+10.261172817 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:03.972727 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.972648    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:03.972887 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.972764    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:03.975066 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:03.974954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:03.975443 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:03.975069    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:04.972909 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:04.972878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:04.973094 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:04.973010    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:05.973012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:05.972975    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:05.973464 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:05.972987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:05.973464 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:05.973123    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:05.973464 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:05.973211    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:06.972578 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:06.972226    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:06.972578 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:06.972346    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:07.558103 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:07.557826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:07.558103 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.558048    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:07.558681 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.558122    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:15.558101875 +0000 UTC m=+18.091157974 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:07.658288 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:07.658250    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:07.658470 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.658382    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:07.658470 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.658450    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:15.658431914 +0000 UTC m=+18.191488017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:07.759320 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:07.759285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:07.759505 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.759438    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:07.759505 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.759460    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:07.759505 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.759473    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:07.759682 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.759537    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:15.759518832 +0000 UTC m=+18.292574932 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:07.972696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:07.972661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:07.973460 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:07.973426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:07.973594 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.973568    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:07.973661 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:07.973635    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:08.973238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:08.972702    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:08.973238 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:08.972831    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:09.972628 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:09.972602    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:09.972766 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:09.972603    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:09.972766 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:09.972707    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:09.972846 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:09.972769    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:10.972948 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:10.972909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:10.973403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:10.973048    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:11.972918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:11.972881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:11.973104 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:11.973026    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:11.973104 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:11.973089    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:11.973497 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:11.973197    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:12.972861 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:12.972829    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:12.973046 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:12.972957    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:13.972941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:13.972901    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:13.973439 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:13.973038    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:13.973439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:13.973088    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:13.973439 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:13.973220    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:14.972210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:14.972175    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:14.972478 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:14.972295    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:15.617523 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:15.617482    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:15.617946 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.617665    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:15.617946 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.617725    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:18:31.617709117 +0000 UTC m=+34.150765215 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:15.718391 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:15.718354    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:15.718603 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.718474    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:15.718603 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.718564    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:31.718526922 +0000 UTC m=+34.251583031 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:15.819243 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:15.819205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:15.819430 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.819371    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 19:18:15.819430 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.819391    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 19:18:15.819430 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.819402    2562 projected.go:196] Error preparing data for projected volume kube-api-access-hpvxv for pod openshift-network-diagnostics/network-check-target-zctnk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:15.819616 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.819465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv podName:59066108-fdcc-44ee-9852-38b85a918368 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:31.819446617 +0000 UTC m=+34.352502717 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hpvxv" (UniqueName: "kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv") pod "network-check-target-zctnk" (UID: "59066108-fdcc-44ee-9852-38b85a918368") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 19:18:15.972720 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:15.972635    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:15.972876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:15.972636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:15.972876 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.972756    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:15.972876 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:15.972842    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:16.972062 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:16.972033    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:16.972524 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:16.972143    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:17.973695 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:17.973662    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:17.974145 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:17.973786    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:17.974145 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:17.973843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:17.974145 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:17.973972    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:18.973120 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:18.972962    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:18.973255 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:18.973231    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:19.092683 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.092659    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5m9j9" event={"ID":"6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36","Type":"ContainerStarted","Data":"0c616ef70bbb0ae3ed34400c28589169809be19ef012fbd35de9e59f7e87f23f"}
Sep 11 19:18:19.095015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.094993    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"e59e182e31327ed0332c93957d46b979dffb1f1986bb4e5ae4e427b8e0a3afc5"}
Sep 11 19:18:19.095117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.095056    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"c57748a2435b58f175437d424c35da61bc97b553e324e6f3d77d6640f34fb4db"}
Sep 11 19:18:19.095117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.095087    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"657ea31776b3f7582fce70bb81cb37830d2698e8f8e9b348b527c9c23fd7a5d3"}
Sep 11 19:18:19.095227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.095130    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"4d28ccfdb9c4416e405900c0b36be8c35e80ff69003cf11b04251c68d5fc741e"}
Sep 11 19:18:19.098913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.096474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-g85c6" event={"ID":"74166b65-c6a3-4163-9c57-ca19bbf3fcb9","Type":"ContainerStarted","Data":"2d1340b06e589e15aa133985783ca3ee3be18b80bb3601c773145cf20ea863cd"}
Sep 11 19:18:19.100629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.100606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f65bd" event={"ID":"23640b3d-6229-4075-b5ad-70f60d7b6a31","Type":"ContainerStarted","Data":"a1483eee5083c348708db3a005dc36c6cbf593b1117f30fa843402d3c7eb000f"}
Sep 11 19:18:19.101949 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.101929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8" event={"ID":"4265e0a7-72a7-4370-9a42-2b5cc31252e1","Type":"ContainerStarted","Data":"a131ca2510e4cf9d329c977a1c6c5c7bc3bdebb7951ae916705fbf6ff0330913"}
Sep 11 19:18:19.103354 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.103335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbqg6" event={"ID":"080e8450-92dc-431c-80f9-a549c86f4153","Type":"ContainerStarted","Data":"d0fab07713715fd27cb1c4fa9d1a3432e4b848e7d1d2b7557e00add0d939f53a"}
Sep 11 19:18:19.104837 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.104816    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="6608e8cd043d3f2d8e1b6d1f31e74e9a31062a773fafc8d4991c69886acc569d" exitCode=0
Sep 11 19:18:19.104929 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.104871    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"6608e8cd043d3f2d8e1b6d1f31e74e9a31062a773fafc8d4991c69886acc569d"}
Sep 11 19:18:19.106423 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.106404    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nhn9z" event={"ID":"84ce9764-735d-42d2-b705-4acea50831eb","Type":"ContainerStarted","Data":"4adce4f1e0c8c8e61cccdfdd9d32f3be1808e69028f2e3d482334cea8211310f"}
Sep 11 19:18:19.107288 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.107248    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5m9j9" podStartSLOduration=3.49693638 podStartE2EDuration="21.107233386s" totalImagesPullingTime="17.610297006s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:19.106756673 +0000 UTC m=+21.639812868" watchObservedRunningTime="2026-09-11 19:18:19.107233386 +0000 UTC m=+21.640289508"
Sep 11 19:18:19.107343 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.107318    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-0.ec2.internal" podStartSLOduration=20.107312154 podStartE2EDuration="20.107312154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:03.076329859 +0000 UTC m=+5.609385980" watchObservedRunningTime="2026-09-11 19:18:19.107312154 +0000 UTC m=+21.640368274"
Sep 11 19:18:19.124655 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.124618    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nbqg6" podStartSLOduration=3.512386471 podStartE2EDuration="21.124606512s" totalImagesPullingTime="17.612220041s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:19.124445177 +0000 UTC m=+21.657501326" watchObservedRunningTime="2026-09-11 19:18:19.124606512 +0000 UTC m=+21.657662632"
Sep 11 19:18:19.138316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.138281    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-g85c6" podStartSLOduration=3.513398046 podStartE2EDuration="21.138269883s" totalImagesPullingTime="17.624871837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:19.137978993 +0000 UTC m=+21.671035115" watchObservedRunningTime="2026-09-11 19:18:19.138269883 +0000 UTC m=+21.671326003"
Sep 11 19:18:19.184471 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.184428    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f65bd" podStartSLOduration=7.619984109 podStartE2EDuration="21.184414704s" totalImagesPullingTime="13.564430595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:19.184218023 +0000 UTC m=+21.717274170" watchObservedRunningTime="2026-09-11 19:18:19.184414704 +0000 UTC m=+21.717470825"
Sep 11 19:18:19.204291 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.204216    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nhn9z" podStartSLOduration=3.483341377 podStartE2EDuration="21.20419844s" totalImagesPullingTime="17.720857063s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:19.203900044 +0000 UTC m=+21.736956176" watchObservedRunningTime="2026-09-11 19:18:19.20419844 +0000 UTC m=+21.737254576"
Sep 11 19:18:19.973175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.973147    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:19.973378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:19.973185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:19.973378 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:19.973259    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:19.973495 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:19.973381    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:20.112255 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.112228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"b335292b7707a2e3a19a70745d9fbaecd7fc0036ae26c054d38ed617dd65640e"}
Sep 11 19:18:20.112763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.112298    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"7536c0cb25ebf712dfae275a5990e671f376218826775d709a0698dba35a1743"}
Sep 11 19:18:20.114344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.114304    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tj7ds" event={"ID":"509842df-2ad1-4990-9280-d04a0d9d805b","Type":"ContainerStarted","Data":"bf5fbdf357a251d4f925f6df902b7a182137b93c1c2f8dd8c693d0a4dc192e84"}
Sep 11 19:18:20.129800 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.129738    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tj7ds" podStartSLOduration=4.510980041 podStartE2EDuration="22.12971882s" totalImagesPullingTime="17.618738779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:20.129700378 +0000 UTC m=+22.662756537" watchObservedRunningTime="2026-09-11 19:18:20.12971882 +0000 UTC m=+22.662774943"
Sep 11 19:18:20.246329 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.246304    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 19:18:20.941493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.941388    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T19:18:20.246323468Z","UUID":"cd89b62d-f920-4e72-ba35-60821c037b1f","Handler":null,"Name":"","Endpoint":""}
Sep 11 19:18:20.942835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.942816    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 19:18:20.942941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.942848    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 19:18:20.972871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:20.972840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:20.973043 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:20.972954    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:21.118610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:21.118576    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8" event={"ID":"4265e0a7-72a7-4370-9a42-2b5cc31252e1","Type":"ContainerStarted","Data":"27c318b6a120ee105be0724c75449847d87265422c3dd7c7b522bc049178b6bc"}
Sep 11 19:18:21.940871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:21.940832    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:21.941358 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:21.941339    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:21.972711 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:21.972681    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:21.972711 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:21.972704    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:21.972933 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:21.972807    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:21.972980 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:21.972955    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:22.125765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.125721    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"5e9f09c199bfa696f36c841fc45e6096a65e2dde19e6457679936461c273f58a"}
Sep 11 19:18:22.128269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.128243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8" event={"ID":"4265e0a7-72a7-4370-9a42-2b5cc31252e1","Type":"ContainerStarted","Data":"f301bf2ca69f567d852e051c2e14cef25cabbe311161c53d4aae7455a90b8969"}
Sep 11 19:18:22.128606 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.128584    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:22.129061 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.129043    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f65bd"
Sep 11 19:18:22.148251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.148202    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8s4v8" podStartSLOduration=4.200015485 podStartE2EDuration="24.148185918s" totalImagesPullingTime="19.948170433s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:22.148076787 +0000 UTC m=+24.681132929" watchObservedRunningTime="2026-09-11 19:18:22.148185918 +0000 UTC m=+24.681242040"
Sep 11 19:18:22.972405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:22.972373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:22.972630 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:22.972466    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:23.972979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:23.972942    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:23.973414 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:23.972994    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:23.973414 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:23.973080    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:23.973414 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:23.973183    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:24.972442 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:24.972282    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:24.972607 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:24.972516    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:25.136676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.136644    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="d74c56957ceb4360a9fa3f48ffe248fe30567df00bcdb2a700424590c2346fee" exitCode=0
Sep 11 19:18:25.137199 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.136731    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"d74c56957ceb4360a9fa3f48ffe248fe30567df00bcdb2a700424590c2346fee"}
Sep 11 19:18:25.140904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.140842    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" event={"ID":"fda4714b-dca9-4be3-ad87-61bca71b4fdc","Type":"ContainerStarted","Data":"97ff81a8d44d5039a30c4cd497665faae4b3f76fa81c376cb45a8dc1d7daa05f"}
Sep 11 19:18:25.141129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.141107    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:25.156036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.156017    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:25.179765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.179726    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm" podStartSLOduration=9.550732965 podStartE2EDuration="27.179713404s" totalImagesPullingTime="17.628980439s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:25.179536697 +0000 UTC m=+27.712592842" watchObservedRunningTime="2026-09-11 19:18:25.179713404 +0000 UTC m=+27.712769525"
Sep 11 19:18:25.972335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.972297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:25.972729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:25.972340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:25.972729 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:25.972412    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:25.972729 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:25.972487    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:26.143950 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.143920    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:26.144564 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.143990    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:26.157724 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.157702    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:26.470870 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.470835    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j2gh7"]
Sep 11 19:18:26.471110 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.470997    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:26.471193 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:26.471112    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:26.473539 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.473508    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tkjf7"]
Sep 11 19:18:26.473681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.473627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:26.473797 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:26.473771    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:26.479315 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.479293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zctnk"]
Sep 11 19:18:26.479429 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:26.479373    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:26.479489 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:26.479461    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:27.147452 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:27.147379    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="cce3d5af8c74e10651bd01cd165ee19d3d66b4ce1a7b7b64095b505a1e0292e0" exitCode=0
Sep 11 19:18:27.147929 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:27.147464    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"cce3d5af8c74e10651bd01cd165ee19d3d66b4ce1a7b7b64095b505a1e0292e0"}
Sep 11 19:18:27.973080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:27.972903    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:27.973246 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:27.973082    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:27.973246 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:27.973037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:27.973246 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:27.973152    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:27.973246 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:27.973220    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:27.973466 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:27.973319    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:29.154084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:29.154053    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="9663fc0da5ed00135a0f2ef0e5c19e9c217cad18fdae6f94605c4150515a6e28" exitCode=0
Sep 11 19:18:29.154480 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:29.154107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"9663fc0da5ed00135a0f2ef0e5c19e9c217cad18fdae6f94605c4150515a6e28"}
Sep 11 19:18:29.972656 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:29.972594    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:29.972813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:29.972660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:29.972813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:29.972594    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:29.972813 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:29.972718    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-zctnk" podUID="59066108-fdcc-44ee-9852-38b85a918368"
Sep 11 19:18:29.972813 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:29.972785    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tkjf7" podUID="b4af5044-6d91-4a9e-980a-07695782c0c3"
Sep 11 19:18:29.972998 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:29.972874    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j2gh7" podUID="a9c3801b-0d71-4655-a745-d78065b1377f"
Sep 11 19:18:31.297587 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.297555    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-0.ec2.internal" event="NodeReady"
Sep 11 19:18:31.298054 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.297705    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 19:18:31.331144 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.331114    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:18:31.335312 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.335296    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.338222 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.338200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 19:18:31.338623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.338596    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 19:18:31.338811 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.338791    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"]
Sep 11 19:18:31.338964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.338944    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 19:18:31.339448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.339274    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8zlw\""
Sep 11 19:18:31.343003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.342986    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5844b856db-dlv9b"]
Sep 11 19:18:31.343117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.343102    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.347047 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347029    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.347140 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347052    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.347140 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.347140 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347036    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5844c87d68-m7h5f"]
Sep 11 19:18:31.347629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347612    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 11 19:18:31.347711 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347649    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gs9kq\""
Sep 11 19:18:31.347814 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.347799    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 11 19:18:31.349171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.349153    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 19:18:31.349616 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.349601    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 11 19:18:31.349674 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.349607    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.350277 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.350257    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.350277 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.350274    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-56p4h\""
Sep 11 19:18:31.350437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.350264    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 11 19:18:31.351799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.351359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.352753 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.352704    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:18:31.354256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354237    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 11 19:18:31.354256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354250    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 11 19:18:31.354402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354239    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.354584 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354566    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 11 19:18:31.354825 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354807    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 11 19:18:31.354977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354831    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.354977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.354842    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tvbcx\""
Sep 11 19:18:31.360254 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.358107    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"]
Sep 11 19:18:31.360254 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.358376    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 11 19:18:31.366569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.366522    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"]
Sep 11 19:18:31.371580 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.371532    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"]
Sep 11 19:18:31.371681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.371628    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"
Sep 11 19:18:31.375322 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.375303    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"]
Sep 11 19:18:31.375438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.375418    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.376386 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.376364    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-ntf56\""
Sep 11 19:18:31.376562 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.376528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.376647 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.376615    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.378914 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.378892    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z6959"]
Sep 11 19:18:31.379044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.379028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.382229 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.382210    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.382523 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.382411    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 11 19:18:31.382634 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.382573    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.382783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.382762    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 11 19:18:31.382879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.382762    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 11 19:18:31.384925 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.383414    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-c5bf9"]
Sep 11 19:18:31.384925 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.383999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.385388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.385369    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.385674 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.385652    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sj285\""
Sep 11 19:18:31.385866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.385847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bhvwz\""
Sep 11 19:18:31.386000 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.385984    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 11 19:18:31.386611 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.386590    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.387871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.387851    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 19:18:31.387871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.387867    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 19:18:31.388477 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.388459    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-257h7\""
Sep 11 19:18:31.388952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.388843    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"]
Sep 11 19:18:31.389066 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.389048    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.391766 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.391729    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 11 19:18:31.392165 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.392146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 11 19:18:31.392322 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.392185    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.392534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.392516    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-k2fdr\""
Sep 11 19:18:31.392824 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.392805    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"]
Sep 11 19:18:31.393535 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.393012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.393935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.393918    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.395493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.395473    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wpfc2\""
Sep 11 19:18:31.396615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.396596    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 19:18:31.397042 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.397019    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.397216 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.396861    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.397515 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.396896    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.398140 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.396803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-dlv9b"]
Sep 11 19:18:31.398268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.398172    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-d52s8"]
Sep 11 19:18:31.399838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.399818    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 11 19:18:31.399983 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.399956    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmm9g\""
Sep 11 19:18:31.400674 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.400278    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 11 19:18:31.400674 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.400579    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 11 19:18:31.403032 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.403002    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"]
Sep 11 19:18:31.403309 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.403281    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.406126 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.406106    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.406323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.406297    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.406415 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.406399    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ndgb2\""
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408169    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6959"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408234    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-c5bf9"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408253    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408275    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5844c87d68-m7h5f"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408294    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d52s8"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408369    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"]
Sep 11 19:18:31.409787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.408463    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"
Sep 11 19:18:31.411270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.411252    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 19:18:31.411270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.411260    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-9ptnf\""
Sep 11 19:18:31.411427 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.411264    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 19:18:31.437392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.437486 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.437486 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437423    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-stats-auth\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.437765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.437765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fd7s\" (UniqueName: \"kubernetes.io/projected/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-kube-api-access-5fd7s\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.437765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437616    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.437765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-service-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.437765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437782    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437819    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pws5z\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vplpj\" (UniqueName: \"kubernetes.io/projected/a64daf77-c537-4f55-a39b-4fd39746000c-kube-api-access-vplpj\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.438001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.437977    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-default-certificate\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a64daf77-c537-4f55-a39b-4fd39746000c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438085    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-tmp\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438157    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.438227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438214    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8197fa-426d-48b8-a5ae-c5fd43c79714-serving-cert\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.438462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-snapshots\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.438462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.438266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgpnf\" (UniqueName: \"kubernetes.io/projected/6f8197fa-426d-48b8-a5ae-c5fd43c79714-kube-api-access-xgpnf\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.523724 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.523689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:31.539557 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dz5bw\" (UniqueName: \"kubernetes.io/projected/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-kube-api-access-dz5bw\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.539780 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.539780 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xtgr\" (UniqueName: \"kubernetes.io/projected/7c90ab68-9b10-49fb-a663-11a1f424a479-kube-api-access-8xtgr\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.539780 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgpnf\" (UniqueName: \"kubernetes.io/projected/6f8197fa-426d-48b8-a5ae-c5fd43c79714-kube-api-access-xgpnf\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.539780 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539661    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.539780 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539688    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-stats-auth\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.540035 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.539793    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:31.540035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539863    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.540035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.539920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540035 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.539958    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.039931827 +0000 UTC m=+34.572987944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:31.540035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540002    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-service-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540037    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c90ab68-9b10-49fb-a663-11a1f424a479-tmp-dir\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540080    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540106    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vplpj\" (UniqueName: \"kubernetes.io/projected/a64daf77-c537-4f55-a39b-4fd39746000c-kube-api-access-vplpj\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gwgw9\" (UniqueName: \"kubernetes.io/projected/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-kube-api-access-gwgw9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540159    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540185    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pws5z\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540233    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-tmp\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540290    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540313    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-snapshots\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20e4aea2-7d0f-4280-9f21-f476cdf933f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540348    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjftf\" (UniqueName: \"kubernetes.io/projected/3bf51b14-c5b9-461a-b6b4-bb0992307c37-kube-api-access-cjftf\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2fg\" (UniqueName: \"kubernetes.io/projected/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-kube-api-access-jx2fg\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k52cz\" (UniqueName: \"kubernetes.io/projected/f71c54bb-4912-483f-b020-33a1eb031704-kube-api-access-k52cz\") pod \"network-check-source-6f8b768455-d7lrt\" (UID: \"f71c54bb-4912-483f-b020-33a1eb031704\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540468    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fd7s\" (UniqueName: \"kubernetes.io/projected/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-kube-api-access-5fd7s\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.540577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540575    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-serving-cert\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540587    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-service-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2m6z\" (UniqueName: \"kubernetes.io/projected/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-kube-api-access-f2m6z\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540700    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-config\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-default-certificate\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-serving-cert\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c90ab68-9b10-49fb-a663-11a1f424a479-config-volume\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540854    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6f8197fa-426d-48b8-a5ae-c5fd43c79714-trusted-ca-bundle\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a64daf77-c537-4f55-a39b-4fd39746000c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540900    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-tmp\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.540981    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.540994    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.540998    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmswt\" (UniqueName: \"kubernetes.io/projected/347de126-fe77-4fd7-8c67-b6472814cc4e-kube-api-access-qmswt\") pod \"volume-data-source-validator-86695b7cc7-5nbwr\" (UID: \"347de126-fe77-4fd7-8c67-b6472814cc4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-trusted-ca\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.541117 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.541050    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.041033443 +0000 UTC m=+34.574089544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541128    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8197fa-426d-48b8-a5ae-c5fd43c79714-serving-cert\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541180    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf51b14-c5b9-461a-b6b4-bb0992307c37-cert\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-config\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541502    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/6f8197fa-426d-48b8-a5ae-c5fd43c79714-snapshots\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.541641    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.041623473 +0000 UTC m=+34.574679595 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.541671    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:31.541774 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.541719    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.041702283 +0000 UTC m=+34.574758401 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:31.542251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.541932    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a64daf77-c537-4f55-a39b-4fd39746000c-telemetry-config\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.542312 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.542299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.542749 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.542723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.544952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.544907    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.544952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.544934    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-default-certificate\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.544952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.544937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-stats-auth\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.545158 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.545019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.545598 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.545506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6f8197fa-426d-48b8-a5ae-c5fd43c79714-serving-cert\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.549500 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.549466    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgpnf\" (UniqueName: \"kubernetes.io/projected/6f8197fa-426d-48b8-a5ae-c5fd43c79714-kube-api-access-xgpnf\") pod \"insights-operator-5844b856db-dlv9b\" (UID: \"6f8197fa-426d-48b8-a5ae-c5fd43c79714\") " pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.549784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.549741    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fd7s\" (UniqueName: \"kubernetes.io/projected/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-kube-api-access-5fd7s\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:31.550142 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.550122    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.550241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.550225    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vplpj\" (UniqueName: \"kubernetes.io/projected/a64daf77-c537-4f55-a39b-4fd39746000c-kube-api-access-vplpj\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:31.550575 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.550556    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pws5z\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:31.611082 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.611001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:31.642407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-config\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.642407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642412    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-serving-cert\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.642618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642434    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c90ab68-9b10-49fb-a663-11a1f424a479-config-volume\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.642618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmswt\" (UniqueName: \"kubernetes.io/projected/347de126-fe77-4fd7-8c67-b6472814cc4e-kube-api-access-qmswt\") pod \"volume-data-source-validator-86695b7cc7-5nbwr\" (UID: \"347de126-fe77-4fd7-8c67-b6472814cc4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"
Sep 11 19:18:31.642618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642611    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-trusted-ca\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.642760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.642760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642672    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf51b14-c5b9-461a-b6b4-bb0992307c37-cert\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.642760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642701    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-config\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.642760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dz5bw\" (UniqueName: \"kubernetes.io/projected/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-kube-api-access-dz5bw\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.642760 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.642754    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:31.643003 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.642831    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.142811951 +0000 UTC m=+34.675868052 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:31.643003 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.642836    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:31.643003 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.642898    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.142881325 +0000 UTC m=+34.675937445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:31.643003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.642757    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.643003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643000    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xtgr\" (UniqueName: \"kubernetes.io/projected/7c90ab68-9b10-49fb-a663-11a1f424a479-kube-api-access-8xtgr\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643062    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c90ab68-9b10-49fb-a663-11a1f424a479-tmp-dir\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643106    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7c90ab68-9b10-49fb-a663-11a1f424a479-config-volume\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643113    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gwgw9\" (UniqueName: \"kubernetes.io/projected/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-kube-api-access-gwgw9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643187    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-config\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643202    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20e4aea2-7d0f-4280-9f21-f476cdf933f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjftf\" (UniqueName: \"kubernetes.io/projected/3bf51b14-c5b9-461a-b6b4-bb0992307c37-kube-api-access-cjftf\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.643275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2fg\" (UniqueName: \"kubernetes.io/projected/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-kube-api-access-jx2fg\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643288    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k52cz\" (UniqueName: \"kubernetes.io/projected/f71c54bb-4912-483f-b020-33a1eb031704-kube-api-access-k52cz\") pod \"network-check-source-6f8b768455-d7lrt\" (UID: \"f71c54bb-4912-483f-b020-33a1eb031704\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643367    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c90ab68-9b10-49fb-a663-11a1f424a479-tmp-dir\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643373    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643422    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-serving-cert\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2m6z\" (UniqueName: \"kubernetes.io/projected/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-kube-api-access-f2m6z\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.643689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643476    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-trusted-ca\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.643743    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.643801    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:32.143787151 +0000 UTC m=+34.676843269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.643831    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.643911    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret podName:a9c3801b-0d71-4655-a745-d78065b1377f nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.643895507 +0000 UTC m=+66.176951620 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret") pod "global-pull-secret-syncer-j2gh7" (UID: "a9c3801b-0d71-4655-a745-d78065b1377f") : object "kube-system"/"original-pull-secret" not registered
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.643825    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-config\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.644094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.644026    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-config\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.644475 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.644448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/20e4aea2-7d0f-4280-9f21-f476cdf933f0-nginx-conf\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:31.645153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.645131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-serving-cert\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.645454 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.645433    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3bf51b14-c5b9-461a-b6b4-bb0992307c37-cert\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.646019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.646001    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-serving-cert\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.646098 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.646031    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-serving-cert\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.653330 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.653201    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dz5bw\" (UniqueName: \"kubernetes.io/projected/3c29ff86-fa2f-4d24-b201-f2adda3f2f4e-kube-api-access-dz5bw\") pod \"service-ca-operator-cf7c776b7-5bnf9\" (UID: \"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e\") " pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.653673 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.653650    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjftf\" (UniqueName: \"kubernetes.io/projected/3bf51b14-c5b9-461a-b6b4-bb0992307c37-kube-api-access-cjftf\") pod \"ingress-canary-d52s8\" (UID: \"3bf51b14-c5b9-461a-b6b4-bb0992307c37\") " pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.653765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.653717    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2m6z\" (UniqueName: \"kubernetes.io/projected/3da161bf-30d4-447b-a4fe-c8242dbe9e1f-kube-api-access-f2m6z\") pod \"console-operator-696884fb9c-c5bf9\" (UID: \"3da161bf-30d4-447b-a4fe-c8242dbe9e1f\") " pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.653872 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.653849    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmswt\" (UniqueName: \"kubernetes.io/projected/347de126-fe77-4fd7-8c67-b6472814cc4e-kube-api-access-qmswt\") pod \"volume-data-source-validator-86695b7cc7-5nbwr\" (UID: \"347de126-fe77-4fd7-8c67-b6472814cc4e\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"
Sep 11 19:18:31.654001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.653973    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k52cz\" (UniqueName: \"kubernetes.io/projected/f71c54bb-4912-483f-b020-33a1eb031704-kube-api-access-k52cz\") pod \"network-check-source-6f8b768455-d7lrt\" (UID: \"f71c54bb-4912-483f-b020-33a1eb031704\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"
Sep 11 19:18:31.654256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.654239    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xtgr\" (UniqueName: \"kubernetes.io/projected/7c90ab68-9b10-49fb-a663-11a1f424a479-kube-api-access-8xtgr\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:31.654333 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.654310    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2fg\" (UniqueName: \"kubernetes.io/projected/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-kube-api-access-jx2fg\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:31.655396 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.655379    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gwgw9\" (UniqueName: \"kubernetes.io/projected/41f61dfc-e449-42ea-bfa4-14a6c0c0ebce-kube-api-access-gwgw9\") pod \"kube-storage-version-migrator-operator-6c8f84f897-lnfsg\" (UID: \"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.663113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.663094    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5844b856db-dlv9b"
Sep 11 19:18:31.686972 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.686746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"
Sep 11 19:18:31.697261 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.697080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"
Sep 11 19:18:31.707106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.707085    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"
Sep 11 19:18:31.723149 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.722929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:31.745175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.744196    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:31.745175 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.744393    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:31.745175 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:31.744468    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs podName:b4af5044-6d91-4a9e-980a-07695782c0c3 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.744446165 +0000 UTC m=+66.277502269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs") pod "network-metrics-daemon-tkjf7" (UID: "b4af5044-6d91-4a9e-980a-07695782c0c3") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 19:18:31.745175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.744931    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-d52s8"
Sep 11 19:18:31.750113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.749921    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"
Sep 11 19:18:31.845881 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.845251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:31.854645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.854619    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvxv\" (UniqueName: \"kubernetes.io/projected/59066108-fdcc-44ee-9852-38b85a918368-kube-api-access-hpvxv\") pod \"network-check-target-zctnk\" (UID: \"59066108-fdcc-44ee-9852-38b85a918368\") " pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:31.954443 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.954360    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5844b856db-dlv9b"]
Sep 11 19:18:31.957253 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:31.957225    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f8197fa_426d_48b8_a5ae_c5fd43c79714.slice/crio-ac4694a9349bdd04676f1122f9422827767094451ebf0b500ea62ba701c89fcc WatchSource:0}: Error finding container ac4694a9349bdd04676f1122f9422827767094451ebf0b500ea62ba701c89fcc: Status 404 returned error can't find the container with id ac4694a9349bdd04676f1122f9422827767094451ebf0b500ea62ba701c89fcc
Sep 11 19:18:31.972978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.972957    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:18:31.972978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.972974    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:31.973136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.972966    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:18:31.976316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.975960    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:18:31.976316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.976020    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:18:31.976316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.976133    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht26q\""
Sep 11 19:18:31.976316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.976202    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-tdnq7\""
Sep 11 19:18:31.982946 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.982923    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr"]
Sep 11 19:18:31.986297 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:31.986271    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod347de126_fe77_4fd7_8c67_b6472814cc4e.slice/crio-aa3759fc7d379146de2ab2f63ebc39f7ef4807b10822bc92d7fd4aa34961a94d WatchSource:0}: Error finding container aa3759fc7d379146de2ab2f63ebc39f7ef4807b10822bc92d7fd4aa34961a94d: Status 404 returned error can't find the container with id aa3759fc7d379146de2ab2f63ebc39f7ef4807b10822bc92d7fd4aa34961a94d
Sep 11 19:18:31.996691 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:31.996669    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg"]
Sep 11 19:18:32.000536 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.000512    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41f61dfc_e449_42ea_bfa4_14a6c0c0ebce.slice/crio-c2eefff0ae5fadd7b0d57e310586c1a03478ecc3982bcca7bdeb1a74bb0c830e WatchSource:0}: Error finding container c2eefff0ae5fadd7b0d57e310586c1a03478ecc3982bcca7bdeb1a74bb0c830e: Status 404 returned error can't find the container with id c2eefff0ae5fadd7b0d57e310586c1a03478ecc3982bcca7bdeb1a74bb0c830e
Sep 11 19:18:32.003669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.003650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:32.025137 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.025110    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9"]
Sep 11 19:18:32.027299 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.027269    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c29ff86_fa2f_4d24_b201_f2adda3f2f4e.slice/crio-fcaf339fc3caccf1161eddbaac0be844e4060380c9a7d7da49fb0e50810299af WatchSource:0}: Error finding container fcaf339fc3caccf1161eddbaac0be844e4060380c9a7d7da49fb0e50810299af: Status 404 returned error can't find the container with id fcaf339fc3caccf1161eddbaac0be844e4060380c9a7d7da49fb0e50810299af
Sep 11 19:18:32.047848 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.047816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:32.048005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.047866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:32.048005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.047900    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:32.048005 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.047950    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:32.048005 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.047965    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:32.048204 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048021    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.048002758 +0000 UTC m=+35.581058873 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:32.048204 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048019    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:32.048204 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048042    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.048030103 +0000 UTC m=+35.581086222 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:32.048204 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.048050932 +0000 UTC m=+35.581107047 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:32.048204 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.048127    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:32.048453 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048287    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:32.048453 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.048341    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.048326084 +0000 UTC m=+35.581382200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:32.050202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.050163    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-696884fb9c-c5bf9"]
Sep 11 19:18:32.054842 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.054812    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da161bf_30d4_447b_a4fe_c8242dbe9e1f.slice/crio-c5f4aef4ca284153542c47df6eb7e0e7a463aa4efac7105331e193d40ae0a25d WatchSource:0}: Error finding container c5f4aef4ca284153542c47df6eb7e0e7a463aa4efac7105331e193d40ae0a25d: Status 404 returned error can't find the container with id c5f4aef4ca284153542c47df6eb7e0e7a463aa4efac7105331e193d40ae0a25d
Sep 11 19:18:32.073685 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.073627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-d52s8"]
Sep 11 19:18:32.074119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.074094    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt"]
Sep 11 19:18:32.078000 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.077962    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf51b14_c5b9_461a_b6b4_bb0992307c37.slice/crio-b8aae44999177ab6a983767c6c06dfd1011dc50ec998aba6b14e04446697b3a9 WatchSource:0}: Error finding container b8aae44999177ab6a983767c6c06dfd1011dc50ec998aba6b14e04446697b3a9: Status 404 returned error can't find the container with id b8aae44999177ab6a983767c6c06dfd1011dc50ec998aba6b14e04446697b3a9
Sep 11 19:18:32.078773 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.078749    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf71c54bb_4912_483f_b020_33a1eb031704.slice/crio-1156d0983d416fc041e15b44971ebab790b36aa6766396bbf39105329f54f6e8 WatchSource:0}: Error finding container 1156d0983d416fc041e15b44971ebab790b36aa6766396bbf39105329f54f6e8: Status 404 returned error can't find the container with id 1156d0983d416fc041e15b44971ebab790b36aa6766396bbf39105329f54f6e8
Sep 11 19:18:32.149473 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.149439    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:32.149473 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.149477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:32.149682 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.149523    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:32.149682 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149586    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:32.149682 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149650    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:32.149788 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149650    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:32.149788 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149653    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.149633908 +0000 UTC m=+35.682690008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:32.149788 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149724    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.149712492 +0000 UTC m=+35.682768594 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:32.149788 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:32.149740    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:33.14973394 +0000 UTC m=+35.682790039 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:32.162843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.162798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" event={"ID":"3da161bf-30d4-447b-a4fe-c8242dbe9e1f","Type":"ContainerStarted","Data":"c5f4aef4ca284153542c47df6eb7e0e7a463aa4efac7105331e193d40ae0a25d"}
Sep 11 19:18:32.163962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.163942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9" event={"ID":"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e","Type":"ContainerStarted","Data":"fcaf339fc3caccf1161eddbaac0be844e4060380c9a7d7da49fb0e50810299af"}
Sep 11 19:18:32.165067 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.165047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dlv9b" event={"ID":"6f8197fa-426d-48b8-a5ae-c5fd43c79714","Type":"ContainerStarted","Data":"ac4694a9349bdd04676f1122f9422827767094451ebf0b500ea62ba701c89fcc"}
Sep 11 19:18:32.166141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.166125    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg" event={"ID":"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce","Type":"ContainerStarted","Data":"c2eefff0ae5fadd7b0d57e310586c1a03478ecc3982bcca7bdeb1a74bb0c830e"}
Sep 11 19:18:32.167323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.167297    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr" event={"ID":"347de126-fe77-4fd7-8c67-b6472814cc4e","Type":"ContainerStarted","Data":"aa3759fc7d379146de2ab2f63ebc39f7ef4807b10822bc92d7fd4aa34961a94d"}
Sep 11 19:18:32.168382 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.168364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt" event={"ID":"f71c54bb-4912-483f-b020-33a1eb031704","Type":"ContainerStarted","Data":"1156d0983d416fc041e15b44971ebab790b36aa6766396bbf39105329f54f6e8"}
Sep 11 19:18:32.169387 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.169370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d52s8" event={"ID":"3bf51b14-c5b9-461a-b6b4-bb0992307c37","Type":"ContainerStarted","Data":"b8aae44999177ab6a983767c6c06dfd1011dc50ec998aba6b14e04446697b3a9"}
Sep 11 19:18:32.283241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:32.283051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-zctnk"]
Sep 11 19:18:32.285582 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:32.285540    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59066108_fdcc_44ee_9852_38b85a918368.slice/crio-d2fb82e5111b08facd6ef29b93e10789b71dd7d363f065b7d54845de48990232 WatchSource:0}: Error finding container d2fb82e5111b08facd6ef29b93e10789b71dd7d363f065b7d54845de48990232: Status 404 returned error can't find the container with id d2fb82e5111b08facd6ef29b93e10789b71dd7d363f065b7d54845de48990232
Sep 11 19:18:33.058076 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.058036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.058089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.058123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.058212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058387    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058449    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.058431277 +0000 UTC m=+37.591487382 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058530    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058541    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058592    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.058577452 +0000 UTC m=+37.591633555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058648    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058680    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.058670041 +0000 UTC m=+37.591726147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:33.058884 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.058741    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.058732121 +0000 UTC m=+37.591788226 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.159125    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.159191    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.159259    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.159404    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.159463    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.159446088 +0000 UTC m=+37.692502205 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.160170    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.160228    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.160212028 +0000 UTC m=+37.693268141 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.160291    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:33.160403 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:33.160326    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:35.160314815 +0000 UTC m=+37.693370928 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:33.180801 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:33.180735    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zctnk" event={"ID":"59066108-fdcc-44ee-9852-38b85a918368","Type":"ContainerStarted","Data":"d2fb82e5111b08facd6ef29b93e10789b71dd7d363f065b7d54845de48990232"}
Sep 11 19:18:34.425537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:34.425358    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:34.531200 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:34.531160    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.079643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.079692    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.079727    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.079819    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.079985    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080050    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.080030909 +0000 UTC m=+41.613087029 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080317    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080332    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.080309083 +0000 UTC m=+41.613365205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080341    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080393    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.080377094 +0000 UTC m=+41.613433198 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:35.080392 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080405    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:35.081149 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.080444    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.080432095 +0000 UTC m=+41.613488199 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:35.181362 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.181321    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:35.181538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.181381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:35.181538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.181453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:35.181652 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.181613    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:35.181686 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.181675    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.181656985 +0000 UTC m=+41.714713090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:35.182102 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.182076    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:35.182228 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.182135    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.182118982 +0000 UTC m=+41.715175082 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:35.182228 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.182198    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:35.182340 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:35.182234    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:39.182222376 +0000 UTC m=+41.715278476 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:35.196669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.195919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr" event={"ID":"347de126-fe77-4fd7-8c67-b6472814cc4e","Type":"ContainerStarted","Data":"339ce39c81cb7ba87c2c351756f02a869786a7fd5ba58880727254a89801d289"}
Sep 11 19:18:35.285648 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.285610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:35.387595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.387414    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:35.941349 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.941311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:35.992664 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:35.992633    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:37.682514 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:37.682457    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log" limit=1024
Sep 11 19:18:39.118308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.118262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.118368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.118400    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118416    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.118431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118478    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.118460963 +0000 UTC m=+49.651517081 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118531    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118566    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.118540119 +0000 UTC m=+49.651596219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118617    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.118597472 +0000 UTC m=+49.651653575 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118533    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118636    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:39.118794 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.118667    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.118659521 +0000 UTC m=+49.651715620 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:39.219588 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.219540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:39.219776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.219604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:39.219776 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219705    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:39.219776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:39.219747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:39.219939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219796    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.219778578 +0000 UTC m=+49.752834692 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:39.219939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219714    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:39.219939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219825    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:39.219939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219870    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.219848108 +0000 UTC m=+49.752904222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:39.219939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:39.219916    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.219891033 +0000 UTC m=+49.752947145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:43.220466 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.220424    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg" event={"ID":"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce","Type":"ContainerStarted","Data":"83f92909896829fe65a6bca5cfe706f79fcaec41f3852ec4ee13fcd6a987daae"}
Sep 11 19:18:43.222597 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.222569    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-zctnk" event={"ID":"59066108-fdcc-44ee-9852-38b85a918368","Type":"ContainerStarted","Data":"bd16192dd96ca1049e9ef2d84f887f7ef01a3d8fc4145175ca931c2b32bc7d69"}
Sep 11 19:18:43.222713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.222622    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:18:43.224437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.224371    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt" event={"ID":"f71c54bb-4912-483f-b020-33a1eb031704","Type":"ContainerStarted","Data":"bd7443ed99d92ef37703f4c0197a6d057770c7a02af65431e4720a87b4725f79"}
Sep 11 19:18:43.226663 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.226647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-d52s8" event={"ID":"3bf51b14-c5b9-461a-b6b4-bb0992307c37","Type":"ContainerStarted","Data":"c895f9eefe7f7bfa3ecf992b3904666c48f37f67e294eb6882a40fd2e0fd2fd1"}
Sep 11 19:18:43.228677 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.228657    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/0.log"
Sep 11 19:18:43.229290 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.228802    2562 generic.go:356] "Generic (PLEG): container finished" podID="3da161bf-30d4-447b-a4fe-c8242dbe9e1f" containerID="57f7e0ffb27e0f2c3cbe1145eab2ce67ae626e80777f772354b06ddcf6b1b837" exitCode=255
Sep 11 19:18:43.229290 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.228899    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" event={"ID":"3da161bf-30d4-447b-a4fe-c8242dbe9e1f","Type":"ContainerDied","Data":"57f7e0ffb27e0f2c3cbe1145eab2ce67ae626e80777f772354b06ddcf6b1b837"}
Sep 11 19:18:43.229290 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.229042    2562 scope.go:117] "RemoveContainer" containerID="57f7e0ffb27e0f2c3cbe1145eab2ce67ae626e80777f772354b06ddcf6b1b837"
Sep 11 19:18:43.232988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.232963    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="b5cfac3befb9c5664cd61da1ca1660ecdc71e6d14c59dbd8aaac2ad45c9ffc57" exitCode=0
Sep 11 19:18:43.233087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.233040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"b5cfac3befb9c5664cd61da1ca1660ecdc71e6d14c59dbd8aaac2ad45c9ffc57"}
Sep 11 19:18:43.235795 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.235771    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9" event={"ID":"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e","Type":"ContainerStarted","Data":"df236a185d05b54d8ef1f1bfab9c57dc01f07b658a488cf1cf6937eea135121f"}
Sep 11 19:18:43.239863 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.239819    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg" podStartSLOduration=34.945855786 podStartE2EDuration="45.239779966s" totalImagesPullingTime="10.29392418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.239220585 +0000 UTC m=+45.772276721" watchObservedRunningTime="2026-09-11 19:18:43.239779966 +0000 UTC m=+45.772836099"
Sep 11 19:18:43.240976 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.240941    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-86695b7cc7-5nbwr" podStartSLOduration=42.805605117 podStartE2EDuration="45.240926148s" totalImagesPullingTime="2.435321031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:35.210817316 +0000 UTC m=+37.743873454" watchObservedRunningTime="2026-09-11 19:18:43.240926148 +0000 UTC m=+45.773982271"
Sep 11 19:18:43.243286 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.243262    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dlv9b" event={"ID":"6f8197fa-426d-48b8-a5ae-c5fd43c79714","Type":"ContainerStarted","Data":"f748bc4e6a5e904586522a85ae4b4220382d8abeae592e400c5c78ffa2576f83"}
Sep 11 19:18:43.281669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.281622    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-zctnk" podStartSLOduration=35.260298591 podStartE2EDuration="45.28160103s" totalImagesPullingTime="10.021302439s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.280967233 +0000 UTC m=+45.814023380" watchObservedRunningTime="2026-09-11 19:18:43.28160103 +0000 UTC m=+45.814657156"
Sep 11 19:18:43.296630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.296585    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9" podStartSLOduration=35.028899817 podStartE2EDuration="45.296533611s" totalImagesPullingTime="10.267633794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.296340309 +0000 UTC m=+45.829396433" watchObservedRunningTime="2026-09-11 19:18:43.296533611 +0000 UTC m=+45.829589713"
Sep 11 19:18:43.367765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.366750    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-d52s8" podStartSLOduration=2.150707361 podStartE2EDuration="12.366729455s" totalImagesPullingTime="10.216022094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.365978843 +0000 UTC m=+45.899034966" watchObservedRunningTime="2026-09-11 19:18:43.366729455 +0000 UTC m=+45.899785578"
Sep 11 19:18:43.367765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.367592    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-d7lrt" podStartSLOduration=35.151256052 podStartE2EDuration="45.36757834s" totalImagesPullingTime="10.216322288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.34842428 +0000 UTC m=+45.881480395" watchObservedRunningTime="2026-09-11 19:18:43.36757834 +0000 UTC m=+45.900634461"
Sep 11 19:18:43.386619 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.386563    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5844b856db-dlv9b" podStartSLOduration=35.049211623 podStartE2EDuration="45.386528483s" totalImagesPullingTime="10.33731686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:43.38550209 +0000 UTC m=+45.918558212" watchObservedRunningTime="2026-09-11 19:18:43.386528483 +0000 UTC m=+45.919584601"
Sep 11 19:18:43.637921 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.637886    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nnvt9"]
Sep 11 19:18:43.660684 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.660656    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnvt9"]
Sep 11 19:18:43.660826 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.660789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.663516 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.663335    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 19:18:43.663516 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.663451    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjmhv\""
Sep 11 19:18:43.663708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.663597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 19:18:43.763879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.763796    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7k44g\" (UniqueName: \"kubernetes.io/projected/c3654226-a98e-4076-b720-df90568cd35e-kube-api-access-7k44g\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.763879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.763841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3654226-a98e-4076-b720-df90568cd35e-data-volume\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.764087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.763958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.764087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.764052    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.764184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.764099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3654226-a98e-4076-b720-df90568cd35e-crio-socket\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865337 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865286    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865511 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:43.865427    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:18:43.865511 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865511 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:43.865509    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:44.3654853 +0000 UTC m=+46.898541419 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : configmap "kube-rbac-proxy" not found
Sep 11 19:18:43.865752 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:43.865592    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:43.865752 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:43.865653    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:44.365628391 +0000 UTC m=+46.898684499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:43.865752 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3654226-a98e-4076-b720-df90568cd35e-crio-socket\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865752 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7k44g\" (UniqueName: \"kubernetes.io/projected/c3654226-a98e-4076-b720-df90568cd35e-kube-api-access-7k44g\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865945 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865759    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3654226-a98e-4076-b720-df90568cd35e-data-volume\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.865945 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.865770    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c3654226-a98e-4076-b720-df90568cd35e-crio-socket\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.866187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.866168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3654226-a98e-4076-b720-df90568cd35e-data-volume\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:43.876771 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:43.876750    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7k44g\" (UniqueName: \"kubernetes.io/projected/c3654226-a98e-4076-b720-df90568cd35e-kube-api-access-7k44g\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:44.249697 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.249663    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:18:44.250132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.250087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/0.log"
Sep 11 19:18:44.250132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.250119    2562 generic.go:356] "Generic (PLEG): container finished" podID="3da161bf-30d4-447b-a4fe-c8242dbe9e1f" containerID="8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893" exitCode=255
Sep 11 19:18:44.250257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.250189    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" event={"ID":"3da161bf-30d4-447b-a4fe-c8242dbe9e1f","Type":"ContainerDied","Data":"8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893"}
Sep 11 19:18:44.250257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.250247    2562 scope.go:117] "RemoveContainer" containerID="57f7e0ffb27e0f2c3cbe1145eab2ce67ae626e80777f772354b06ddcf6b1b837"
Sep 11 19:18:44.250779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.250757    2562 scope.go:117] "RemoveContainer" containerID="8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893"
Sep 11 19:18:44.250978 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:44.250952    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-c5bf9_openshift-console-operator(3da161bf-30d4-447b-a4fe-c8242dbe9e1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" podUID="3da161bf-30d4-447b-a4fe-c8242dbe9e1f"
Sep 11 19:18:44.253986 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.253962    2562 generic.go:356] "Generic (PLEG): container finished" podID="bebe2f75-86c3-426b-bc61-3f42723b9093" containerID="252a167367e649e786b934c0c04c4cbf74a1defd7a0a04fa74cf5d9af24be4ce" exitCode=0
Sep 11 19:18:44.254091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.254046    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerDied","Data":"252a167367e649e786b934c0c04c4cbf74a1defd7a0a04fa74cf5d9af24be4ce"}
Sep 11 19:18:44.372389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.372361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:44.372521 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.372491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:44.372613 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:44.372584    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:44.372680 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:44.372616    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:18:44.372726 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:44.372678    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:45.37265574 +0000 UTC m=+47.905711842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:44.372726 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:44.372700    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:45.372690374 +0000 UTC m=+47.905746480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : configmap "kube-rbac-proxy" not found
Sep 11 19:18:44.549520 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.549446    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"]
Sep 11 19:18:44.573189 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.573160    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"]
Sep 11 19:18:44.573319 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.573289    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"
Sep 11 19:18:44.577448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.577424    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bzlnw\""
Sep 11 19:18:44.577584 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.577482    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 19:18:44.577584 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.577422    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 19:18:44.601215 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.601190    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5m9j9_6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36/dns-node-resolver/0.log"
Sep 11 19:18:44.675104 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.675069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9v5c\" (UniqueName: \"kubernetes.io/projected/99bfb024-cfdc-4e99-8a42-2320482c3f49-kube-api-access-l9v5c\") pod \"migrator-8b4d697c5-mhqfv\" (UID: \"99bfb024-cfdc-4e99-8a42-2320482c3f49\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"
Sep 11 19:18:44.776340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.776301    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9v5c\" (UniqueName: \"kubernetes.io/projected/99bfb024-cfdc-4e99-8a42-2320482c3f49-kube-api-access-l9v5c\") pod \"migrator-8b4d697c5-mhqfv\" (UID: \"99bfb024-cfdc-4e99-8a42-2320482c3f49\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"
Sep 11 19:18:44.784535 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.784504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9v5c\" (UniqueName: \"kubernetes.io/projected/99bfb024-cfdc-4e99-8a42-2320482c3f49-kube-api-access-l9v5c\") pod \"migrator-8b4d697c5-mhqfv\" (UID: \"99bfb024-cfdc-4e99-8a42-2320482c3f49\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"
Sep 11 19:18:44.882240 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:44.882202    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"
Sep 11 19:18:45.164492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.164420    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv"]
Sep 11 19:18:45.167474 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:45.167450    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99bfb024_cfdc_4e99_8a42_2320482c3f49.slice/crio-67e556e489c38bed53d7ee388242178b8f7feb9bf69ec978560e562b6299e80e WatchSource:0}: Error finding container 67e556e489c38bed53d7ee388242178b8f7feb9bf69ec978560e562b6299e80e: Status 404 returned error can't find the container with id 67e556e489c38bed53d7ee388242178b8f7feb9bf69ec978560e562b6299e80e
Sep 11 19:18:45.258432 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.258408    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:18:45.258885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.258799    2562 scope.go:117] "RemoveContainer" containerID="8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893"
Sep 11 19:18:45.259000 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:45.258974    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-c5bf9_openshift-console-operator(3da161bf-30d4-447b-a4fe-c8242dbe9e1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" podUID="3da161bf-30d4-447b-a4fe-c8242dbe9e1f"
Sep 11 19:18:45.262044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.262020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" event={"ID":"bebe2f75-86c3-426b-bc61-3f42723b9093","Type":"ContainerStarted","Data":"1ca1d21cbc988d12d4fe091f2fa227645426cebdeffd070874a0a58b99306849"}
Sep 11 19:18:45.263093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.263074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv" event={"ID":"99bfb024-cfdc-4e99-8a42-2320482c3f49","Type":"ContainerStarted","Data":"67e556e489c38bed53d7ee388242178b8f7feb9bf69ec978560e562b6299e80e"}
Sep 11 19:18:45.296577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.296515    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wlvf9" podStartSLOduration=8.02301533 podStartE2EDuration="47.296500491s" totalImagesPullingTime="39.273485161s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:45.295247807 +0000 UTC m=+47.828303927" watchObservedRunningTime="2026-09-11 19:18:45.296500491 +0000 UTC m=+47.829556611"
Sep 11 19:18:45.382262 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.382228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:45.382411 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:45.382304    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:18:45.382411 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:45.382350    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.382336751 +0000 UTC m=+49.915392849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : configmap "kube-rbac-proxy" not found
Sep 11 19:18:45.382411 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:45.382372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:45.382596 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:45.382466    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:45.382596 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:45.382505    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:47.382486529 +0000 UTC m=+49.915542630 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:46.001585 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.001540    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g85c6_74166b65-c6a3-4163-9c57-ca19bbf3fcb9/node-ca/0.log"
Sep 11 19:18:46.404945 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.404922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d52s8_3bf51b14-c5b9-461a-b6b4-bb0992307c37/serve-healthcheck-canary/0.log"
Sep 11 19:18:46.600346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.600304    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bmswx"]
Sep 11 19:18:46.613073 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.613037    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.614898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.614870    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bmswx"]
Sep 11 19:18:46.615285 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.615252    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 11 19:18:46.615387 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.615305    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 11 19:18:46.616351 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.616332    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 11 19:18:46.616426 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.616358    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-glkdr\""
Sep 11 19:18:46.616426 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.616332    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 11 19:18:46.694789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.694716    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qbxq\" (UniqueName: \"kubernetes.io/projected/0c8c78fa-db8b-4c74-ac53-fae08a69f976-kube-api-access-4qbxq\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.694935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.694839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-cabundle\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.694935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.694889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-key\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.796073 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.796034    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-cabundle\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.796231 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.796100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-key\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.796326 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.796305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qbxq\" (UniqueName: \"kubernetes.io/projected/0c8c78fa-db8b-4c74-ac53-fae08a69f976-kube-api-access-4qbxq\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.796815 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.796794    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-cabundle\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.798487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.798468    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/0c8c78fa-db8b-4c74-ac53-fae08a69f976-signing-key\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.805116 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.805083    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qbxq\" (UniqueName: \"kubernetes.io/projected/0c8c78fa-db8b-4c74-ac53-fae08a69f976-kube-api-access-4qbxq\") pod \"service-ca-568869fdc5-bmswx\" (UID: \"0c8c78fa-db8b-4c74-ac53-fae08a69f976\") " pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:46.924480 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:46.924455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-bmswx"
Sep 11 19:18:47.200681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.200650    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:18:47.200829 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200806    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:47.200888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.200812    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:18:47.200888 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200877    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls podName:a64daf77-c537-4f55-a39b-4fd39746000c nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.200856956 +0000 UTC m=+65.733913054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cd954b897-w8f4m" (UID: "a64daf77-c537-4f55-a39b-4fd39746000c") : secret "cluster-monitoring-operator-tls" not found
Sep 11 19:18:47.200993 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200879    2562 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 19:18:47.200993 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200915    2562 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-f6d8c6c4f-6phkk: secret "image-registry-tls" not found
Sep 11 19:18:47.200993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.200925    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:47.200993 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200976    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls podName:f03f8a71-8717-4165-b424-4c2b9cfdae09 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.200956696 +0000 UTC m=+65.734012826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls") pod "image-registry-f6d8c6c4f-6phkk" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09") : secret "image-registry-tls" not found
Sep 11 19:18:47.201169 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.200995    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 11 19:18:47.201169 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.201019    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:18:47.201169 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.201033    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.201018648 +0000 UTC m=+65.734074748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : secret "router-metrics-certs-default" not found
Sep 11 19:18:47.201169 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.201102    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle podName:e7bc7717-75c3-4536-80b3-5e65e41f2fb7 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.201090488 +0000 UTC m=+65.734146591 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle") pod "router-default-5844c87d68-m7h5f" (UID: "e7bc7717-75c3-4536-80b3-5e65e41f2fb7") : configmap references non-existent config key: service-ca.crt
Sep 11 19:18:47.258162 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.258099    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-bmswx"]
Sep 11 19:18:47.260807 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:47.260780    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8c78fa_db8b_4c74_ac53_fae08a69f976.slice/crio-f391679f68a85f93b257eca095a31f492d06ed16ef587b3b0c190dcf988d46ad WatchSource:0}: Error finding container f391679f68a85f93b257eca095a31f492d06ed16ef587b3b0c190dcf988d46ad: Status 404 returned error can't find the container with id f391679f68a85f93b257eca095a31f492d06ed16ef587b3b0c190dcf988d46ad
Sep 11 19:18:47.272101 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.272075    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv" event={"ID":"99bfb024-cfdc-4e99-8a42-2320482c3f49","Type":"ContainerStarted","Data":"16c604df3bd028863b67de1295f8b132bba166533384571dc1f8812634d86e19"}
Sep 11 19:18:47.272198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.272120    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv" event={"ID":"99bfb024-cfdc-4e99-8a42-2320482c3f49","Type":"ContainerStarted","Data":"153a94c7fba378d051f1b593867dc3d274179615f9e6b1c984fa7052785ad889"}
Sep 11 19:18:47.273079 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.273060    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bmswx" event={"ID":"0c8c78fa-db8b-4c74-ac53-fae08a69f976","Type":"ContainerStarted","Data":"f391679f68a85f93b257eca095a31f492d06ed16ef587b3b0c190dcf988d46ad"}
Sep 11 19:18:47.302431 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.302403    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:18:47.302521 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.302503    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:18:47.302592 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302552    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 19:18:47.302676 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302657    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 19:18:47.302714 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.302668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:18:47.302765 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302716    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls podName:7c90ab68-9b10-49fb-a663-11a1f424a479 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.302698353 +0000 UTC m=+65.835754465 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls") pod "dns-default-z6959" (UID: "7c90ab68-9b10-49fb-a663-11a1f424a479") : secret "dns-default-metrics-tls" not found
Sep 11 19:18:47.302765 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302751    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls podName:4b8eabbe-e1bf-49d0-8315-fe2738cc9f13 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.302728389 +0000 UTC m=+65.835784501 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-zvwpf" (UID: "4b8eabbe-e1bf-49d0-8315-fe2738cc9f13") : secret "samples-operator-tls" not found
Sep 11 19:18:47.302842 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302774    2562 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 11 19:18:47.302842 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.302837    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert podName:20e4aea2-7d0f-4280-9f21-f476cdf933f0 nodeName:}" failed. No retries permitted until 2026-09-11 19:19:03.30282151 +0000 UTC m=+65.835877612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert") pod "networking-console-plugin-5dcbc7df6b-79frs" (UID: "20e4aea2-7d0f-4280-9f21-f476cdf933f0") : secret "networking-console-plugin-cert" not found
Sep 11 19:18:47.314676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.314633    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mhqfv" podStartSLOduration=1.595225164 podStartE2EDuration="3.314620487s" totalImagesPullingTime="1.719395323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:47.313737175 +0000 UTC m=+49.846793295" watchObservedRunningTime="2026-09-11 19:18:47.314620487 +0000 UTC m=+49.847676623"
Sep 11 19:18:47.403654 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.403615    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:47.403820 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:47.403687    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:47.403820 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.403759    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 19:18:47.403918 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.403823    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:51.403809273 +0000 UTC m=+53.936865372 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : configmap "kube-rbac-proxy" not found
Sep 11 19:18:47.403918 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.403828    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:47.403918 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:47.403864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:51.40385371 +0000 UTC m=+53.936909810 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:48.279923 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:48.279840    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-bmswx" event={"ID":"0c8c78fa-db8b-4c74-ac53-fae08a69f976","Type":"ContainerStarted","Data":"86d882db62548f4f769421b6e6282bcf054aad6c831a28bc3bbd7a1fd601b8cf"}
Sep 11 19:18:48.301490 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:48.301436    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-bmswx" podStartSLOduration=2.301416748 podStartE2EDuration="2.301416748s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:18:48.299154012 +0000 UTC m=+50.832210145" watchObservedRunningTime="2026-09-11 19:18:48.301416748 +0000 UTC m=+50.834472871"
Sep 11 19:18:51.443775 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.443729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:51.444289 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.443822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:51.444289 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:51.443966    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:51.444289 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:51.444033    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls podName:c3654226-a98e-4076-b720-df90568cd35e nodeName:}" failed. No retries permitted until 2026-09-11 19:18:59.444018528 +0000 UTC m=+61.977074626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nnvt9" (UID: "c3654226-a98e-4076-b720-df90568cd35e") : secret "insights-runtime-extractor-tls" not found
Sep 11 19:18:51.444463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.444440    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c3654226-a98e-4076-b720-df90568cd35e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:51.723664 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.723570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:51.723664 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.723628    2562 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:18:51.723981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:51.723967    2562 scope.go:117] "RemoveContainer" containerID="8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893"
Sep 11 19:18:51.724138 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:18:51.724120    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-696884fb9c-c5bf9_openshift-console-operator(3da161bf-30d4-447b-a4fe-c8242dbe9e1f)\"" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" podUID="3da161bf-30d4-447b-a4fe-c8242dbe9e1f"
Sep 11 19:18:58.160191 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:58.160159    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vmggm"
Sep 11 19:18:59.516978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:59.516943    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:59.519270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:59.519247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c3654226-a98e-4076-b720-df90568cd35e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nnvt9\" (UID: \"c3654226-a98e-4076-b720-df90568cd35e\") " pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:59.572621 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:59.572594    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pjmhv\""
Sep 11 19:18:59.580922 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:59.580905    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nnvt9"
Sep 11 19:18:59.849502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:18:59.849471    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nnvt9"]
Sep 11 19:18:59.852474 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:18:59.852447    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3654226_a98e_4076_b720_df90568cd35e.slice/crio-4852cf739bba4bec6e35bf10a32137731759bb4f8d0d4ed54779ff6ca64463c4 WatchSource:0}: Error finding container 4852cf739bba4bec6e35bf10a32137731759bb4f8d0d4ed54779ff6ca64463c4: Status 404 returned error can't find the container with id 4852cf739bba4bec6e35bf10a32137731759bb4f8d0d4ed54779ff6ca64463c4
Sep 11 19:19:00.317091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:00.317009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnvt9" event={"ID":"c3654226-a98e-4076-b720-df90568cd35e","Type":"ContainerStarted","Data":"181dfc0756578726db1a0e9f46fd85f4fa2939c2c886dc32eeae0d5865667f6c"}
Sep 11 19:19:00.317091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:00.317068    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnvt9" event={"ID":"c3654226-a98e-4076-b720-df90568cd35e","Type":"ContainerStarted","Data":"4852cf739bba4bec6e35bf10a32137731759bb4f8d0d4ed54779ff6ca64463c4"}
Sep 11 19:19:01.321965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:01.321929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnvt9" event={"ID":"c3654226-a98e-4076-b720-df90568cd35e","Type":"ContainerStarted","Data":"448f729e35a3cb242f32f6d1c779bdd66606d6f1ec2fa00ba67ed6343e56068d"}
Sep 11 19:19:03.250916 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.250877    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:19:03.251524 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.250951    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:03.251524 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.250973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:03.251524 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.250992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:03.251703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.251523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-service-ca-bundle\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:03.253493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.253461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a64daf77-c537-4f55-a39b-4fd39746000c-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cd954b897-w8f4m\" (UID: \"a64daf77-c537-4f55-a39b-4fd39746000c\") " pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:19:03.253601 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.253473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e7bc7717-75c3-4536-80b3-5e65e41f2fb7-metrics-certs\") pod \"router-default-5844c87d68-m7h5f\" (UID: \"e7bc7717-75c3-4536-80b3-5e65e41f2fb7\") " pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:03.253601 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.253473    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"image-registry-f6d8c6c4f-6phkk\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") " pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:03.330685 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.330649    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nnvt9" event={"ID":"c3654226-a98e-4076-b720-df90568cd35e","Type":"ContainerStarted","Data":"36c5d957f8a3a2363b3a83897e0008dc511c632f1ace030cbbffdc5ac2f990fb"}
Sep 11 19:19:03.353644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.351213    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nnvt9" podStartSLOduration=17.813633251 podStartE2EDuration="20.351186387s" totalImagesPullingTime="2.537553136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:18:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:03.349278467 +0000 UTC m=+65.882334608" watchObservedRunningTime="2026-09-11 19:19:03.351186387 +0000 UTC m=+65.884242510"
Sep 11 19:19:03.353644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.353033    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:19:03.353644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.353089    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:19:03.353644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.353148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:19:03.355931 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.355903    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7c90ab68-9b10-49fb-a663-11a1f424a479-metrics-tls\") pod \"dns-default-z6959\" (UID: \"7c90ab68-9b10-49fb-a663-11a1f424a479\") " pod="openshift-dns/dns-default-z6959"
Sep 11 19:19:03.356587 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.356568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/20e4aea2-7d0f-4280-9f21-f476cdf933f0-networking-console-plugin-cert\") pod \"networking-console-plugin-5dcbc7df6b-79frs\" (UID: \"20e4aea2-7d0f-4280-9f21-f476cdf933f0\") " pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:19:03.356638 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.356588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4b8eabbe-e1bf-49d0-8315-fe2738cc9f13-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-zvwpf\" (UID: \"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:19:03.448565 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.448515    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-q8zlw\""
Sep 11 19:19:03.456019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.455996    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:03.456770 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.456753    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-gs9kq\""
Sep 11 19:19:03.465039 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.465020    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"
Sep 11 19:19:03.473745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.473720    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-tvbcx\""
Sep 11 19:19:03.482148 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.482122    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:03.519344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.519316    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-257h7\""
Sep 11 19:19:03.527646 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.527133    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z6959"
Sep 11 19:19:03.532141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.532114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wpfc2\""
Sep 11 19:19:03.540686 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.540664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"
Sep 11 19:19:03.541373 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.541030    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-vmm9g\""
Sep 11 19:19:03.547710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.547651    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"
Sep 11 19:19:03.656404 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.656355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:19:03.659062 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.659040    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 19:19:03.669350 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.669326    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a9c3801b-0d71-4655-a745-d78065b1377f-original-pull-secret\") pod \"global-pull-secret-syncer-j2gh7\" (UID: \"a9c3801b-0d71-4655-a745-d78065b1377f\") " pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:19:03.729129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.729103    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:19:03.731469 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:03.731445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03f8a71_8717_4165_b424_4c2b9cfdae09.slice/crio-13a8d114ba66e3cbd3fe44a72e15997847052e4555d56a30a3f9b51b2f07fe95 WatchSource:0}: Error finding container 13a8d114ba66e3cbd3fe44a72e15997847052e4555d56a30a3f9b51b2f07fe95: Status 404 returned error can't find the container with id 13a8d114ba66e3cbd3fe44a72e15997847052e4555d56a30a3f9b51b2f07fe95
Sep 11 19:19:03.751570 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.751532    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m"]
Sep 11 19:19:03.757473 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.757413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:19:03.759931 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.759913    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 19:19:03.762585 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:03.762560    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda64daf77_c537_4f55_a39b_4fd39746000c.slice/crio-001e8c868b75e4b112d15e3b0ae95e7e256756cd7449168d57a0da483411fab4 WatchSource:0}: Error finding container 001e8c868b75e4b112d15e3b0ae95e7e256756cd7449168d57a0da483411fab4: Status 404 returned error can't find the container with id 001e8c868b75e4b112d15e3b0ae95e7e256756cd7449168d57a0da483411fab4
Sep 11 19:19:03.770680 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.770659    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4af5044-6d91-4a9e-980a-07695782c0c3-metrics-certs\") pod \"network-metrics-daemon-tkjf7\" (UID: \"b4af5044-6d91-4a9e-980a-07695782c0c3\") " pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:19:03.775706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.775685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5844c87d68-m7h5f"]
Sep 11 19:19:03.778297 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:03.778277    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7bc7717_75c3_4536_80b3_5e65e41f2fb7.slice/crio-dcf29afef03542ad9593915d49bf312c649a17566f4ebfc41af9e6bbc4bcdc1c WatchSource:0}: Error finding container dcf29afef03542ad9593915d49bf312c649a17566f4ebfc41af9e6bbc4bcdc1c: Status 404 returned error can't find the container with id dcf29afef03542ad9593915d49bf312c649a17566f4ebfc41af9e6bbc4bcdc1c
Sep 11 19:19:03.792198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.792180    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht26q\""
Sep 11 19:19:03.797154 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.797127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j2gh7"
Sep 11 19:19:03.800003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.799981    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tkjf7"
Sep 11 19:19:03.824706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.824393    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf"]
Sep 11 19:19:03.836740 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.836671    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs"]
Sep 11 19:19:03.837912 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:03.837716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z6959"]
Sep 11 19:19:03.841090 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:03.841053    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e4aea2_7d0f_4280_9f21_f476cdf933f0.slice/crio-36ab351f71a5a3fb88f9d909bc899dddf14582b5eb5477dcc71ddd01efcc533b WatchSource:0}: Error finding container 36ab351f71a5a3fb88f9d909bc899dddf14582b5eb5477dcc71ddd01efcc533b: Status 404 returned error can't find the container with id 36ab351f71a5a3fb88f9d909bc899dddf14582b5eb5477dcc71ddd01efcc533b
Sep 11 19:19:04.090844 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.090803    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j2gh7"]
Sep 11 19:19:04.092096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.092073    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tkjf7"]
Sep 11 19:19:04.093860 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:04.093836    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c3801b_0d71_4655_a745_d78065b1377f.slice/crio-05057b74123277361027e6132e8e6f5dabe856a09f95c5f254483200994dfc76 WatchSource:0}: Error finding container 05057b74123277361027e6132e8e6f5dabe856a09f95c5f254483200994dfc76: Status 404 returned error can't find the container with id 05057b74123277361027e6132e8e6f5dabe856a09f95c5f254483200994dfc76
Sep 11 19:19:04.094202 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:04.094169    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4af5044_6d91_4a9e_980a_07695782c0c3.slice/crio-7f4cd1591988960a1d20d28b9eacb4810a46b4043e4313126b79c3fad36dc15a WatchSource:0}: Error finding container 7f4cd1591988960a1d20d28b9eacb4810a46b4043e4313126b79c3fad36dc15a: Status 404 returned error can't find the container with id 7f4cd1591988960a1d20d28b9eacb4810a46b4043e4313126b79c3fad36dc15a
Sep 11 19:19:04.336310 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.336273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs" event={"ID":"20e4aea2-7d0f-4280-9f21-f476cdf933f0","Type":"ContainerStarted","Data":"36ab351f71a5a3fb88f9d909bc899dddf14582b5eb5477dcc71ddd01efcc533b"}
Sep 11 19:19:04.337486 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.337459    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m" event={"ID":"a64daf77-c537-4f55-a39b-4fd39746000c","Type":"ContainerStarted","Data":"001e8c868b75e4b112d15e3b0ae95e7e256756cd7449168d57a0da483411fab4"}
Sep 11 19:19:04.339749 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.339720    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5844c87d68-m7h5f" event={"ID":"e7bc7717-75c3-4536-80b3-5e65e41f2fb7","Type":"ContainerStarted","Data":"751f98ab95ffac664cadbc1b16a58c1737429aa81c00e96acfbfc68fd546323f"}
Sep 11 19:19:04.339863 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.339767    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5844c87d68-m7h5f" event={"ID":"e7bc7717-75c3-4536-80b3-5e65e41f2fb7","Type":"ContainerStarted","Data":"dcf29afef03542ad9593915d49bf312c649a17566f4ebfc41af9e6bbc4bcdc1c"}
Sep 11 19:19:04.341973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.341892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" event={"ID":"f03f8a71-8717-4165-b424-4c2b9cfdae09","Type":"ContainerStarted","Data":"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"}
Sep 11 19:19:04.341973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.341951    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" event={"ID":"f03f8a71-8717-4165-b424-4c2b9cfdae09","Type":"ContainerStarted","Data":"13a8d114ba66e3cbd3fe44a72e15997847052e4555d56a30a3f9b51b2f07fe95"}
Sep 11 19:19:04.342115 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.341974    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:04.343457 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.343433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkjf7" event={"ID":"b4af5044-6d91-4a9e-980a-07695782c0c3","Type":"ContainerStarted","Data":"7f4cd1591988960a1d20d28b9eacb4810a46b4043e4313126b79c3fad36dc15a"}
Sep 11 19:19:04.344668 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.344643    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6959" event={"ID":"7c90ab68-9b10-49fb-a663-11a1f424a479","Type":"ContainerStarted","Data":"818f3a718fff64f68e3ce9a2439535ae1c968d0c30954cd99850ddeb367cb198"}
Sep 11 19:19:04.345918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.345898    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf" event={"ID":"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13","Type":"ContainerStarted","Data":"2fbb2fae99e732ae069165c726ef4fc4f749b6b09c266ff190798282c6b4f0ae"}
Sep 11 19:19:04.347111 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.347092    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j2gh7" event={"ID":"a9c3801b-0d71-4655-a745-d78065b1377f","Type":"ContainerStarted","Data":"05057b74123277361027e6132e8e6f5dabe856a09f95c5f254483200994dfc76"}
Sep 11 19:19:04.359251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.359208    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5844c87d68-m7h5f" podStartSLOduration=66.359195709 podStartE2EDuration="1m6.359195709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:04.358091505 +0000 UTC m=+66.891147656" watchObservedRunningTime="2026-09-11 19:19:04.359195709 +0000 UTC m=+66.892251841"
Sep 11 19:19:04.378086 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.378003    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" podStartSLOduration=66.377982616 podStartE2EDuration="1m6.377982616s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:04.376367533 +0000 UTC m=+66.909423687" watchObservedRunningTime="2026-09-11 19:19:04.377982616 +0000 UTC m=+66.911038739"
Sep 11 19:19:04.482768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.482732    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:04.485623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:04.485381    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:05.355194 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:05.355121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:05.357687 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:05.357469    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5844c87d68-m7h5f"
Sep 11 19:19:05.973347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:05.973297    2562 scope.go:117] "RemoveContainer" containerID="8602013be54fcc7ddf26a010af7fb63754a4f198f0f21a64c58d19dadffb0893"
Sep 11 19:19:08.377195 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.376724    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs" event={"ID":"20e4aea2-7d0f-4280-9f21-f476cdf933f0","Type":"ContainerStarted","Data":"9a4865084737597de05fdab25d5a378e20a9399e539824738240cced0de3c4a1"}
Sep 11 19:19:08.379090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.379065    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:19:08.379238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.379168    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" event={"ID":"3da161bf-30d4-447b-a4fe-c8242dbe9e1f","Type":"ContainerStarted","Data":"334a34f82f3a50bb241d48207658e4d813536dead017c23bb83c250ab7c23742"}
Sep 11 19:19:08.379471 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.379452    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:19:08.381023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.380999    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m" event={"ID":"a64daf77-c537-4f55-a39b-4fd39746000c","Type":"ContainerStarted","Data":"e214f33cd34633f552d1db055a5d78abeafd8c531a88bf28cd93b8367a44ac06"}
Sep 11 19:19:08.383316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.383290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkjf7" event={"ID":"b4af5044-6d91-4a9e-980a-07695782c0c3","Type":"ContainerStarted","Data":"5d16b07bffb5649087f558b9f791bbda4634edbb64f39d2d884e910333511574"}
Sep 11 19:19:08.383430 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.383343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tkjf7" event={"ID":"b4af5044-6d91-4a9e-980a-07695782c0c3","Type":"ContainerStarted","Data":"22654394e5823aba6e35bc84bc58c69680867ef82ab220e9399dc70462fa8755"}
Sep 11 19:19:08.385405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.385310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6959" event={"ID":"7c90ab68-9b10-49fb-a663-11a1f424a479","Type":"ContainerStarted","Data":"61eb1e0e58b239030a171d36d657dfd4f196db808a28fffad4b5bb28a33fa00d"}
Sep 11 19:19:08.385405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.385362    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z6959"
Sep 11 19:19:08.385405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.385386    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z6959" event={"ID":"7c90ab68-9b10-49fb-a663-11a1f424a479","Type":"ContainerStarted","Data":"0f68d6d41911397a8408314eeeb8401050d5b007abd98915399836803eff6d13"}
Sep 11 19:19:08.387448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.387419    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf" event={"ID":"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13","Type":"ContainerStarted","Data":"db7719cf62aef717992d0d08436c0ffeb5e3c1c5592e04852cd0905e563abc0d"}
Sep 11 19:19:08.387522 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.387465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf" event={"ID":"4b8eabbe-e1bf-49d0-8315-fe2738cc9f13","Type":"ContainerStarted","Data":"fb15261769ce5250503c4669fb5b5bc0dbf2e42f1f7479887803fbd9b621fd87"}
Sep 11 19:19:08.398616 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.398569    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-5dcbc7df6b-79frs" podStartSLOduration=39.810225663 podStartE2EDuration="43.39853236s" totalImagesPullingTime="3.588306697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.397370233 +0000 UTC m=+70.930426382" watchObservedRunningTime="2026-09-11 19:19:08.39853236 +0000 UTC m=+70.931588481"
Sep 11 19:19:08.456830 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.456441    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9" podStartSLOduration=60.218498543 podStartE2EDuration="1m10.456421666s" totalImagesPullingTime="10.237923123s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.424604232 +0000 UTC m=+70.957660364" watchObservedRunningTime="2026-09-11 19:19:08.456421666 +0000 UTC m=+70.989477795"
Sep 11 19:19:08.457607 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.457562    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-z6959" podStartSLOduration=33.866800015 podStartE2EDuration="37.457529784s" totalImagesPullingTime="3.590729769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:18:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.457524498 +0000 UTC m=+70.990580670" watchObservedRunningTime="2026-09-11 19:19:08.457529784 +0000 UTC m=+70.990585920"
Sep 11 19:19:08.485763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.485700    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tkjf7" podStartSLOduration=67.147934504 podStartE2EDuration="1m10.485680405s" totalImagesPullingTime="3.337745901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.483063919 +0000 UTC m=+71.016120063" watchObservedRunningTime="2026-09-11 19:19:08.485680405 +0000 UTC m=+71.018736529"
Sep 11 19:19:08.496540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.496507    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"]
Sep 11 19:19:08.522296 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.520504    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-zvwpf" podStartSLOduration=66.947619937 podStartE2EDuration="1m10.52048354s" totalImagesPullingTime="3.572863603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.519250197 +0000 UTC m=+71.052306319" watchObservedRunningTime="2026-09-11 19:19:08.52048354 +0000 UTC m=+71.053539685"
Sep 11 19:19:08.531323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.530101    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"]
Sep 11 19:19:08.531521 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.531497    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.534887 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.534865    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 19:19:08.536868 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.536739    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 19:19:08.537487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.537469    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 19:19:08.544084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.544065    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"]
Sep 11 19:19:08.544211 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.544188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.550191 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.550145    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 11 19:19:08.550409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.550369    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 11 19:19:08.550482 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.550420    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-ccs2v\""
Sep 11 19:19:08.553431 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.553248    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cd954b897-w8f4m" podStartSLOduration=66.88363248 podStartE2EDuration="1m10.553229638s" totalImagesPullingTime="3.669597158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:08.551398584 +0000 UTC m=+71.084454729" watchObservedRunningTime="2026-09-11 19:19:08.553229638 +0000 UTC m=+71.086285762"
Sep 11 19:19:08.566397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.566217    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"]
Sep 11 19:19:08.566397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.566263    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"]
Sep 11 19:19:08.566397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.566282    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"]
Sep 11 19:19:08.566397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.566372    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.569688 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.569665    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 19:19:08.569802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.569705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 19:19:08.575324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.575267    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 19:19:08.575579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.575560    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 19:19:08.613769 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.613735    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"]
Sep 11 19:19:08.636381 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.636315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:08.640141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.639949    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-5fp96\""
Sep 11 19:19:08.640650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.640627    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 11 19:19:08.640975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.640953    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"]
Sep 11 19:19:08.696847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.696818    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-696884fb9c-c5bf9"
Sep 11 19:19:08.705324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.705457 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.705457 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705421    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xddw9\" (UniqueName: \"kubernetes.io/projected/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-kube-api-access-xddw9\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.705457 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.705629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705469    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-tmp\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.705629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.705629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705503    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.705629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705568    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f36a077-da91-4bdd-9041-023dee6e6478-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.705823 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705632    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.705823 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbjnf\" (UniqueName: \"kubernetes.io/projected/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-kube-api-access-tbjnf\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.705823 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.705706    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-956tr\" (UniqueName: \"kubernetes.io/projected/7f36a077-da91-4bdd-9041-023dee6e6478-kube-api-access-956tr\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.806665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbjnf\" (UniqueName: \"kubernetes.io/projected/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-kube-api-access-tbjnf\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.807257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.806711    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-956tr\" (UniqueName: \"kubernetes.io/projected/7f36a077-da91-4bdd-9041-023dee6e6478-kube-api-access-956tr\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.806744    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807263    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xddw9\" (UniqueName: \"kubernetes.io/projected/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-kube-api-access-xddw9\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807341    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807368    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-tmp\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f36a077-da91-4bdd-9041-023dee6e6478-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.807869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807752    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1149e940-772d-4b80-8323-095b402d54e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-kkckg\" (UID: \"1149e940-772d-4b80-8323-095b402d54e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:08.808015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.807881    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-tmp\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.808518 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.808461    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/7f36a077-da91-4bdd-9041-023dee6e6478-additional-service-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.810391 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.810363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.810498 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.810481    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.811152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.811130    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-klusterlet-config\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.811241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.811189    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.811298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.811247    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.811361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.811315    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/7f36a077-da91-4bdd-9041-023dee6e6478-ca\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.827757 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.827699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbjnf\" (UniqueName: \"kubernetes.io/projected/8ebb7053-674b-48ad-8b7b-ee29e872bdc6-kube-api-access-tbjnf\") pod \"klusterlet-addon-workmgr-5c5d8bd878-gzcdg\" (UID: \"8ebb7053-674b-48ad-8b7b-ee29e872bdc6\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.828696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.828671    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xddw9\" (UniqueName: \"kubernetes.io/projected/7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9-kube-api-access-xddw9\") pod \"managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2\" (UID: \"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.828882 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.828832    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-956tr\" (UniqueName: \"kubernetes.io/projected/7f36a077-da91-4bdd-9041-023dee6e6478-kube-api-access-956tr\") pod \"cluster-proxy-proxy-agent-55956596fb-w2wvm\" (UID: \"7f36a077-da91-4bdd-9041-023dee6e6478\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.843631 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.843608    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:08.865033 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.864998    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"
Sep 11 19:19:08.878190 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.878160    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"
Sep 11 19:19:08.909159 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.909104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1149e940-772d-4b80-8323-095b402d54e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-kkckg\" (UID: \"1149e940-772d-4b80-8323-095b402d54e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:08.912363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.912311    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/1149e940-772d-4b80-8323-095b402d54e0-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-kkckg\" (UID: \"1149e940-772d-4b80-8323-095b402d54e0\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:08.961438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:08.961410    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:10.065483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.065454    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2"]
Sep 11 19:19:10.068941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.068837    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"]
Sep 11 19:19:10.070324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.070305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm"]
Sep 11 19:19:10.073926 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.073908    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"]
Sep 11 19:19:10.135691 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:10.135650    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7a2e5a15_0357_4d50_84e0_0a6cf4c56cb9.slice/crio-7860fd3035f184a06bf8da6158ffea47281784ebdd2b80160f68e07f7a7fea11 WatchSource:0}: Error finding container 7860fd3035f184a06bf8da6158ffea47281784ebdd2b80160f68e07f7a7fea11: Status 404 returned error can't find the container with id 7860fd3035f184a06bf8da6158ffea47281784ebdd2b80160f68e07f7a7fea11
Sep 11 19:19:10.136456 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:10.136428    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ebb7053_674b_48ad_8b7b_ee29e872bdc6.slice/crio-3f3524696726b18e93fc0ea563d8d64fca7449d71870e917fb3ba8ef045f15ac WatchSource:0}: Error finding container 3f3524696726b18e93fc0ea563d8d64fca7449d71870e917fb3ba8ef045f15ac: Status 404 returned error can't find the container with id 3f3524696726b18e93fc0ea563d8d64fca7449d71870e917fb3ba8ef045f15ac
Sep 11 19:19:10.137506 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:10.137440    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f36a077_da91_4bdd_9041_023dee6e6478.slice/crio-51113d8e65f05bc50f12752a6ae6b74c284b9d34aae18665d6be01c1c6134ed7 WatchSource:0}: Error finding container 51113d8e65f05bc50f12752a6ae6b74c284b9d34aae18665d6be01c1c6134ed7: Status 404 returned error can't find the container with id 51113d8e65f05bc50f12752a6ae6b74c284b9d34aae18665d6be01c1c6134ed7
Sep 11 19:19:10.138417 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:10.138260    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1149e940_772d_4b80_8323_095b402d54e0.slice/crio-509eedde1328ee4f854ed110512ac4eca5f57ba0119d13e66a961780b8d037f0 WatchSource:0}: Error finding container 509eedde1328ee4f854ed110512ac4eca5f57ba0119d13e66a961780b8d037f0: Status 404 returned error can't find the container with id 509eedde1328ee4f854ed110512ac4eca5f57ba0119d13e66a961780b8d037f0
Sep 11 19:19:10.402227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.402181    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg" event={"ID":"8ebb7053-674b-48ad-8b7b-ee29e872bdc6","Type":"ContainerStarted","Data":"3f3524696726b18e93fc0ea563d8d64fca7449d71870e917fb3ba8ef045f15ac"}
Sep 11 19:19:10.403412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.403387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2" event={"ID":"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9","Type":"ContainerStarted","Data":"7860fd3035f184a06bf8da6158ffea47281784ebdd2b80160f68e07f7a7fea11"}
Sep 11 19:19:10.404595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.404567    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg" event={"ID":"1149e940-772d-4b80-8323-095b402d54e0","Type":"ContainerStarted","Data":"509eedde1328ee4f854ed110512ac4eca5f57ba0119d13e66a961780b8d037f0"}
Sep 11 19:19:10.406202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.406178    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j2gh7" event={"ID":"a9c3801b-0d71-4655-a745-d78065b1377f","Type":"ContainerStarted","Data":"e5df91276fa3b213d0e50aca35c3b1832e77b59e7a292b5aa1a9ab7a3965b359"}
Sep 11 19:19:10.407309 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.407288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm" event={"ID":"7f36a077-da91-4bdd-9041-023dee6e6478","Type":"ContainerStarted","Data":"51113d8e65f05bc50f12752a6ae6b74c284b9d34aae18665d6be01c1c6134ed7"}
Sep 11 19:19:10.447229 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:10.447165    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j2gh7" podStartSLOduration=66.365764048 podStartE2EDuration="1m12.447143643s" totalImagesPullingTime="6.081379595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:10.447063399 +0000 UTC m=+72.980119540" watchObservedRunningTime="2026-09-11 19:19:10.447143643 +0000 UTC m=+72.980199759"
Sep 11 19:19:14.257697 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:14.257668    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-zctnk"
Sep 11 19:19:18.393671 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.393640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z6959"
Sep 11 19:19:18.446538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.446501    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm" event={"ID":"7f36a077-da91-4bdd-9041-023dee6e6478","Type":"ContainerStarted","Data":"ccd66c0c2fff736c7dcfca2559a03cd0760a0a79de6deddf65f1086eec1b3284"}
Sep 11 19:19:18.446741 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.446578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm" event={"ID":"7f36a077-da91-4bdd-9041-023dee6e6478","Type":"ContainerStarted","Data":"9475a0ed512f34fe2ffe6702e15878356fd13ceb8e63e66ea9ad0fc904938f4b"}
Sep 11 19:19:18.446741 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.446600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm" event={"ID":"7f36a077-da91-4bdd-9041-023dee6e6478","Type":"ContainerStarted","Data":"e46247b47e04046d2e94ecab19c06c8645a00629c932bb95e4c8aa8f1be877ff"}
Sep 11 19:19:18.447962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.447929    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg" event={"ID":"8ebb7053-674b-48ad-8b7b-ee29e872bdc6","Type":"ContainerStarted","Data":"05baef4ad7487bc5e141e4e1ae5b754b243ad8e0896fb90f6691245b28cb4cf4"}
Sep 11 19:19:18.448088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.448067    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:18.449647 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.449600    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2" event={"ID":"7a2e5a15-0357-4d50-84e0-0a6cf4c56cb9","Type":"ContainerStarted","Data":"c3afa77af24109c2748f1b060552ad20a99baa88580dad0c49b42e41ff806e50"}
Sep 11 19:19:18.450031 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.450013    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg"
Sep 11 19:19:18.451188 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.451170    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg" event={"ID":"1149e940-772d-4b80-8323-095b402d54e0","Type":"ContainerStarted","Data":"1d20fb1c0165ab1432c29ab608ee3dcc6a371dab8b1e6d0ff2a6d08a4e2b5832"}
Sep 11 19:19:18.451344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.451333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:18.455756 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.455736    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg"
Sep 11 19:19:18.479505 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.479461    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-kkckg" podStartSLOduration=3.129215096 podStartE2EDuration="10.479448659s" totalImagesPullingTime="7.350233563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:18.479426823 +0000 UTC m=+81.012482964" watchObservedRunningTime="2026-09-11 19:19:18.479448659 +0000 UTC m=+81.012504774"
Sep 11 19:19:18.500760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.500717    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5c5d8bd878-gzcdg" podStartSLOduration=3.131332006 podStartE2EDuration="10.500705591s" totalImagesPullingTime="7.369373585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:18.499902536 +0000 UTC m=+81.032958657" watchObservedRunningTime="2026-09-11 19:19:18.500705591 +0000 UTC m=+81.033761712"
Sep 11 19:19:18.515997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.515956    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7cb7c9fcb-jmpb2" podStartSLOduration=3.164380413 podStartE2EDuration="10.515940495s" totalImagesPullingTime="7.351560082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:18.515028353 +0000 UTC m=+81.048084475" watchObservedRunningTime="2026-09-11 19:19:18.515940495 +0000 UTC m=+81.048996620"
Sep 11 19:19:18.537195 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:18.537157    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-55956596fb-w2wvm" podStartSLOduration=3.168305283 podStartE2EDuration="10.537143513s" totalImagesPullingTime="7.36883823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:19:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:18.535971122 +0000 UTC m=+81.069027243" watchObservedRunningTime="2026-09-11 19:19:18.537143513 +0000 UTC m=+81.070199634"
Sep 11 19:19:23.464679 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:23.461444    2562 patch_prober.go:28] interesting pod/image-registry-f6d8c6c4f-6phkk container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 19:19:23.464679 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:23.461537    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:19:25.359146 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:25.359117    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:30.751183 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:30.751146    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:19:32.474127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.474088    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m5m5v"]
Sep 11 19:19:32.479087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.479063    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.483318 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.483297    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 19:19:32.483441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.483407    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 19:19:32.483579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.483558    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 19:19:32.483807 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.483791    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6zjdh\""
Sep 11 19:19:32.483939 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.483794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 19:19:32.613701 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qshhp\" (UniqueName: \"kubernetes.io/projected/b870ff00-792c-4b52-9432-d3f7b32a6a7e-kube-api-access-qshhp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613701 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613703    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613764    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-sys\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-tls\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613850    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-root\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-textfile\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-wtmp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.613918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.614143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.613926    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-metrics-client-ca\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.714901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.714864    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-tls\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.714920    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-root\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.714955    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-textfile\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.714979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-wtmp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715003    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715035    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-metrics-client-ca\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-root\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715066    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qshhp\" (UniqueName: \"kubernetes.io/projected/b870ff00-792c-4b52-9432-d3f7b32a6a7e-kube-api-access-qshhp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715134    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715184    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-sys\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715277    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-sys\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715339    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-wtmp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.715384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.715363    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-textfile\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.716154 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.716127    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-accelerators-collector-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.716272 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.716176    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b870ff00-792c-4b52-9432-d3f7b32a6a7e-metrics-client-ca\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.717433 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.717405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-tls\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.717580 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.717560    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b870ff00-792c-4b52-9432-d3f7b32a6a7e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.722786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.722760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qshhp\" (UniqueName: \"kubernetes.io/projected/b870ff00-792c-4b52-9432-d3f7b32a6a7e-kube-api-access-qshhp\") pod \"node-exporter-m5m5v\" (UID: \"b870ff00-792c-4b52-9432-d3f7b32a6a7e\") " pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.789633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:32.789540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m5m5v"
Sep 11 19:19:32.803959 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:19:32.803932    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb870ff00_792c_4b52_9432_d3f7b32a6a7e.slice/crio-814ddf602a9eaf111f13b57cb3f30e1d7dce0a064beec3dc9412da349fbc1cb8 WatchSource:0}: Error finding container 814ddf602a9eaf111f13b57cb3f30e1d7dce0a064beec3dc9412da349fbc1cb8: Status 404 returned error can't find the container with id 814ddf602a9eaf111f13b57cb3f30e1d7dce0a064beec3dc9412da349fbc1cb8
Sep 11 19:19:33.509468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:33.509431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5m5v" event={"ID":"b870ff00-792c-4b52-9432-d3f7b32a6a7e","Type":"ContainerStarted","Data":"814ddf602a9eaf111f13b57cb3f30e1d7dce0a064beec3dc9412da349fbc1cb8"}
Sep 11 19:19:34.515917 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:34.515883    2562 generic.go:356] "Generic (PLEG): container finished" podID="b870ff00-792c-4b52-9432-d3f7b32a6a7e" containerID="b9559212cdaef74d2bd9f5b82ef03087ccc1e3bd74620a21729d849978d9d999" exitCode=0
Sep 11 19:19:34.516263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:34.515928    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5m5v" event={"ID":"b870ff00-792c-4b52-9432-d3f7b32a6a7e","Type":"ContainerDied","Data":"b9559212cdaef74d2bd9f5b82ef03087ccc1e3bd74620a21729d849978d9d999"}
Sep 11 19:19:35.522304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:35.522266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5m5v" event={"ID":"b870ff00-792c-4b52-9432-d3f7b32a6a7e","Type":"ContainerStarted","Data":"8ff03e5f04e4c9d85d0dac3a458e34c880c8c0d7b28e5ee6cbea0af525d2dcc1"}
Sep 11 19:19:35.522798 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:35.522328    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m5m5v" event={"ID":"b870ff00-792c-4b52-9432-d3f7b32a6a7e","Type":"ContainerStarted","Data":"194cffdab6c8e55e5365276a09ffdee3b31ee6b83cebe8418645af7ef2db750d"}
Sep 11 19:19:35.546602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:35.546517    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m5m5v" podStartSLOduration=2.320859446 podStartE2EDuration="3.546496594s" totalImagesPullingTime="1.162405029s" totalInitContainerRuntime="63.232119ms" isStatefulPod=true podCreationTimestamp="2026-09-11 19:19:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:19:35.545296784 +0000 UTC m=+98.078352927" watchObservedRunningTime="2026-09-11 19:19:35.546496594 +0000 UTC m=+98.079552718"
Sep 11 19:19:53.592417 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.592380    2562 generic.go:356] "Generic (PLEG): container finished" podID="41f61dfc-e449-42ea-bfa4-14a6c0c0ebce" containerID="83f92909896829fe65a6bca5cfe706f79fcaec41f3852ec4ee13fcd6a987daae" exitCode=0
Sep 11 19:19:53.592847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.592455    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg" event={"ID":"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce","Type":"ContainerDied","Data":"83f92909896829fe65a6bca5cfe706f79fcaec41f3852ec4ee13fcd6a987daae"}
Sep 11 19:19:53.592847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.592832    2562 scope.go:117] "RemoveContainer" containerID="83f92909896829fe65a6bca5cfe706f79fcaec41f3852ec4ee13fcd6a987daae"
Sep 11 19:19:53.594125 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.594102    2562 generic.go:356] "Generic (PLEG): container finished" podID="3c29ff86-fa2f-4d24-b201-f2adda3f2f4e" containerID="df236a185d05b54d8ef1f1bfab9c57dc01f07b658a488cf1cf6937eea135121f" exitCode=0
Sep 11 19:19:53.594204 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.594146    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9" event={"ID":"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e","Type":"ContainerDied","Data":"df236a185d05b54d8ef1f1bfab9c57dc01f07b658a488cf1cf6937eea135121f"}
Sep 11 19:19:53.594379 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:53.594366    2562 scope.go:117] "RemoveContainer" containerID="df236a185d05b54d8ef1f1bfab9c57dc01f07b658a488cf1cf6937eea135121f"
Sep 11 19:19:54.599925 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:54.599886    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-cf7c776b7-5bnf9" event={"ID":"3c29ff86-fa2f-4d24-b201-f2adda3f2f4e","Type":"ContainerStarted","Data":"27ad7e0b859ec3c4051895a9e52bc584d5f15449cc9f43cf1a583ca9f4c31a73"}
Sep 11 19:19:54.601803 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:54.601778    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6c8f84f897-lnfsg" event={"ID":"41f61dfc-e449-42ea-bfa4-14a6c0c0ebce","Type":"ContainerStarted","Data":"52bf2a1bb6f6211cd6b6fe212235192a66d003c3fffea9c5b1e26bab2287fc25"}
Sep 11 19:19:55.776297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:55.776249    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerName="registry" containerID="cri-o://197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53" gracePeriod=30
Sep 11 19:19:56.020369 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.020344    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:56.116403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116376    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116456    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116479    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116510    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116529    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pws5z\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116595    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116896 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116620    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets\") pod \"f03f8a71-8717-4165-b424-4c2b9cfdae09\" (UID: \"f03f8a71-8717-4165-b424-4c2b9cfdae09\") "
Sep 11 19:19:56.116954 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.116904    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:19:56.117051 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.117021    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:19:56.119045 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.119012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:19:56.119173 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.119080    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:19:56.119233 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.119161    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z" (OuterVolumeSpecName: "kube-api-access-pws5z") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "kube-api-access-pws5z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:19:56.119293 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.119274    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:19:56.119386 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.119369    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:19:56.126628 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.126532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f03f8a71-8717-4165-b424-4c2b9cfdae09" (UID: "f03f8a71-8717-4165-b424-4c2b9cfdae09"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:19:56.217876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217844    2562 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.217876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217875    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pws5z\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-kube-api-access-pws5z\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.217876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217887    2562 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-image-registry-private-configuration\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.218096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217898    2562 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f03f8a71-8717-4165-b424-4c2b9cfdae09-installation-pull-secrets\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.218096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217907    2562 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f03f8a71-8717-4165-b424-4c2b9cfdae09-bound-sa-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.218096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217915    2562 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f03f8a71-8717-4165-b424-4c2b9cfdae09-ca-trust-extracted\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.218096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217922    2562 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-registry-certificates\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.218096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.217930    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f03f8a71-8717-4165-b424-4c2b9cfdae09-trusted-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:19:56.615822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.615784    2562 generic.go:356] "Generic (PLEG): container finished" podID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerID="197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53" exitCode=0
Sep 11 19:19:56.615993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.615843    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk"
Sep 11 19:19:56.615993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.615858    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" event={"ID":"f03f8a71-8717-4165-b424-4c2b9cfdae09","Type":"ContainerDied","Data":"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"}
Sep 11 19:19:56.615993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.615919    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-f6d8c6c4f-6phkk" event={"ID":"f03f8a71-8717-4165-b424-4c2b9cfdae09","Type":"ContainerDied","Data":"13a8d114ba66e3cbd3fe44a72e15997847052e4555d56a30a3f9b51b2f07fe95"}
Sep 11 19:19:56.615993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.615938    2562 scope.go:117] "RemoveContainer" containerID="197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"
Sep 11 19:19:56.625160 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.625143    2562 scope.go:117] "RemoveContainer" containerID="197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"
Sep 11 19:19:56.625434 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:19:56.625415    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53\": container with ID starting with 197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53 not found: ID does not exist" containerID="197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"
Sep 11 19:19:56.625492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.625442    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53"} err="failed to get container status \"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53\": rpc error: code = NotFound desc = could not find container \"197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53\": container with ID starting with 197bee4a9769cb581fcf387837b37b50ba16ecaa4d32e9ce5793468ac98aed53 not found: ID does not exist"
Sep 11 19:19:56.636354 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.636330    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:19:56.640091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:56.640070    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-f6d8c6c4f-6phkk"]
Sep 11 19:19:57.977633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:57.977606    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" path="/var/lib/kubelet/pods/f03f8a71-8717-4165-b424-4c2b9cfdae09/volumes"
Sep 11 19:19:58.626353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:58.626322    2562 generic.go:356] "Generic (PLEG): container finished" podID="6f8197fa-426d-48b8-a5ae-c5fd43c79714" containerID="f748bc4e6a5e904586522a85ae4b4220382d8abeae592e400c5c78ffa2576f83" exitCode=0
Sep 11 19:19:58.626613 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:58.626395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dlv9b" event={"ID":"6f8197fa-426d-48b8-a5ae-c5fd43c79714","Type":"ContainerDied","Data":"f748bc4e6a5e904586522a85ae4b4220382d8abeae592e400c5c78ffa2576f83"}
Sep 11 19:19:58.626849 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:58.626832    2562 scope.go:117] "RemoveContainer" containerID="f748bc4e6a5e904586522a85ae4b4220382d8abeae592e400c5c78ffa2576f83"
Sep 11 19:19:59.631818 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:19:59.631786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5844b856db-dlv9b" event={"ID":"6f8197fa-426d-48b8-a5ae-c5fd43c79714","Type":"ContainerStarted","Data":"acaaee2257271490815f14eafd9036791a64cc3ad26db5ff1f72e62ba350f774"}
Sep 11 19:22:57.888852 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:22:57.888820    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:22:57.890751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:22:57.890726    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:22:57.902018 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:22:57.901993    2562 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 19:24:05.959528 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.959494    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"]
Sep 11 19:24:05.959958 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.959820    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerName="registry"
Sep 11 19:24:05.959958 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.959836    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerName="registry"
Sep 11 19:24:05.959958 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.959912    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f03f8a71-8717-4165-b424-4c2b9cfdae09" containerName="registry"
Sep 11 19:24:05.962829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.962813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:05.965894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.965866    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 19:24:05.966105 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.966081    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 19:24:05.966202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.966141    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 19:24:05.966202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.966146    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xtpql\""
Sep 11 19:24:05.966436 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.966418    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 19:24:05.981185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:05.981159    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"]
Sep 11 19:24:06.109801 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.109767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.109996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.109826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.109996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.109854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sc28d\" (UniqueName: \"kubernetes.io/projected/98289b56-4226-41fd-a0ee-06616391e13e-kube-api-access-sc28d\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.109996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.109934    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.109996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.109975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211083 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.210996    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211083 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.211040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211083 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.211059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sc28d\" (UniqueName: \"kubernetes.io/projected/98289b56-4226-41fd-a0ee-06616391e13e-kube-api-access-sc28d\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211083 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.211086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211330 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.211112    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.211631 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.211600    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-manifests\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.213424 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.213402    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/98289b56-4226-41fd-a0ee-06616391e13e-tmp\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.213574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.213497    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.213721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.213703    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/98289b56-4226-41fd-a0ee-06616391e13e-webhook-cert\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.221166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.221147    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sc28d\" (UniqueName: \"kubernetes.io/projected/98289b56-4226-41fd-a0ee-06616391e13e-kube-api-access-sc28d\") pod \"opendatahub-operator-controller-manager-6474799d6-cdwcx\" (UID: \"98289b56-4226-41fd-a0ee-06616391e13e\") " pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.273796 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.273746    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:06.548143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.548116    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"]
Sep 11 19:24:06.550856 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:24:06.550830    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98289b56_4226_41fd_a0ee_06616391e13e.slice/crio-60b68b74caba896839ea42641a2bb3e41347799058032db00cd672d4d8939be2 WatchSource:0}: Error finding container 60b68b74caba896839ea42641a2bb3e41347799058032db00cd672d4d8939be2: Status 404 returned error can't find the container with id 60b68b74caba896839ea42641a2bb3e41347799058032db00cd672d4d8939be2
Sep 11 19:24:06.554826 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.554806    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:24:06.587323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:06.587290    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx" event={"ID":"98289b56-4226-41fd-a0ee-06616391e13e","Type":"ContainerStarted","Data":"60b68b74caba896839ea42641a2bb3e41347799058032db00cd672d4d8939be2"}
Sep 11 19:24:09.604319 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:09.604280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx" event={"ID":"98289b56-4226-41fd-a0ee-06616391e13e","Type":"ContainerStarted","Data":"3b784da4abed6387732f500290716f1b85ca5579824ba1ac4c98cc4f6f19d07b"}
Sep 11 19:24:10.610161 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:10.610126    2562 generic.go:356] "Generic (PLEG): container finished" podID="98289b56-4226-41fd-a0ee-06616391e13e" containerID="3b784da4abed6387732f500290716f1b85ca5579824ba1ac4c98cc4f6f19d07b" exitCode=0
Sep 11 19:24:10.610497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:10.610175    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx" event={"ID":"98289b56-4226-41fd-a0ee-06616391e13e","Type":"ContainerDied","Data":"3b784da4abed6387732f500290716f1b85ca5579824ba1ac4c98cc4f6f19d07b"}
Sep 11 19:24:11.616483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:11.616450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx" event={"ID":"98289b56-4226-41fd-a0ee-06616391e13e","Type":"ContainerStarted","Data":"2816ce11a230295d5eb7138d031b69a70666d21c37e73d0ca264303999ffcd57"}
Sep 11 19:24:11.616928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:11.616530    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:11.637454 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:11.637403    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx" podStartSLOduration=2.290825533 podStartE2EDuration="6.637386391s" totalImagesPullingTime="3.31008574s" totalInitContainerRuntime="1.036475118s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:11.636455588 +0000 UTC m=+374.169511711" watchObservedRunningTime="2026-09-11 19:24:11.637386391 +0000 UTC m=+374.170442512"
Sep 11 19:24:22.623263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:22.623229    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6474799d6-cdwcx"
Sep 11 19:24:31.908540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.908493    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-57c686645c-74fbr"]
Sep 11 19:24:31.916969 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.916939    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:31.919692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.919671    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-b7w5t\""
Sep 11 19:24:31.919804 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.919786    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 19:24:31.920715 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.920685    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 19:24:31.922642 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:31.922613    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57c686645c-74fbr"]
Sep 11 19:24:32.009495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.009455    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6406b6e0-b73f-4f36-9d99-cc65139ec037-tls-certs\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.009495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.009497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6406b6e0-b73f-4f36-9d99-cc65139ec037-tmp\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.009770 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.009595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pszkt\" (UniqueName: \"kubernetes.io/projected/6406b6e0-b73f-4f36-9d99-cc65139ec037-kube-api-access-pszkt\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.110255 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.110222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6406b6e0-b73f-4f36-9d99-cc65139ec037-tmp\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.110412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.110279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pszkt\" (UniqueName: \"kubernetes.io/projected/6406b6e0-b73f-4f36-9d99-cc65139ec037-kube-api-access-pszkt\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.110412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.110316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6406b6e0-b73f-4f36-9d99-cc65139ec037-tls-certs\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.112489 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.112464    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6406b6e0-b73f-4f36-9d99-cc65139ec037-tmp\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.112747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.112730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6406b6e0-b73f-4f36-9d99-cc65139ec037-tls-certs\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.118250 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.118230    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pszkt\" (UniqueName: \"kubernetes.io/projected/6406b6e0-b73f-4f36-9d99-cc65139ec037-kube-api-access-pszkt\") pod \"kube-auth-proxy-57c686645c-74fbr\" (UID: \"6406b6e0-b73f-4f36-9d99-cc65139ec037\") " pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.227782 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.227699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr"
Sep 11 19:24:32.497680 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.497654    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-57c686645c-74fbr"]
Sep 11 19:24:32.500389 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:24:32.500361    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6406b6e0_b73f_4f36_9d99_cc65139ec037.slice/crio-4bb144e418155331177223c94db8d4d8b747e95211fa1fb52d52cb0c63a2afc8 WatchSource:0}: Error finding container 4bb144e418155331177223c94db8d4d8b747e95211fa1fb52d52cb0c63a2afc8: Status 404 returned error can't find the container with id 4bb144e418155331177223c94db8d4d8b747e95211fa1fb52d52cb0c63a2afc8
Sep 11 19:24:32.708506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:32.708471    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr" event={"ID":"6406b6e0-b73f-4f36-9d99-cc65139ec037","Type":"ContainerStarted","Data":"4bb144e418155331177223c94db8d4d8b747e95211fa1fb52d52cb0c63a2afc8"}
Sep 11 19:24:33.230101 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.230064    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:33.233577 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.233536    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.236122 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.236080    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:24:33.236272 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.236188    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-n8dnt\""
Sep 11 19:24:33.236494 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.236472    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 19:24:33.236610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.236496    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 19:24:33.236610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.236470    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 19:24:33.249940 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.249909    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:33.316960 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.316925    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.316960 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.316972    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.317210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.317050    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.317210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.317106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.317210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.317125    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sksb7\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.317210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.317163    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.317210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.317178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417675 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417637    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sksb7\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.417869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417848    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.418113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.417880    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.418827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.418796    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.420611 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.420563    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.422162 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.422137    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.422463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.422442    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.423434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.423411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.428139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.428115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.428244 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.428208    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sksb7\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7\") pod \"istiod-openshift-gateway-7b7995d5cd-4m6rf\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.545659 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.545575    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:33.824683 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:33.824654    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:33.826844 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:24:33.826806    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75abde56_5915_4269_bd2c_348b65b75858.slice/crio-9f6e4eccb07dd2882f88a8f11f3eacd20d40aea7751248d27c89060595c4bba7 WatchSource:0}: Error finding container 9f6e4eccb07dd2882f88a8f11f3eacd20d40aea7751248d27c89060595c4bba7: Status 404 returned error can't find the container with id 9f6e4eccb07dd2882f88a8f11f3eacd20d40aea7751248d27c89060595c4bba7
Sep 11 19:24:34.718211 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:34.718173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" event={"ID":"75abde56-5915-4269-bd2c-348b65b75858","Type":"ContainerStarted","Data":"9f6e4eccb07dd2882f88a8f11f3eacd20d40aea7751248d27c89060595c4bba7"}
Sep 11 19:24:35.727783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:35.727344    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr" event={"ID":"6406b6e0-b73f-4f36-9d99-cc65139ec037","Type":"ContainerStarted","Data":"84197f4cd7ee949a249ffe40b95807fa70207d6fcf1b712078b80e4a355f94c1"}
Sep 11 19:24:35.743816 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:35.743757    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-57c686645c-74fbr" podStartSLOduration=1.8119098930000002 podStartE2EDuration="4.743734848s" totalImagesPullingTime="2.931824955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:35.742531609 +0000 UTC m=+398.275587753" watchObservedRunningTime="2026-09-11 19:24:35.743734848 +0000 UTC m=+398.276790970"
Sep 11 19:24:37.266595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:37.266530    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:37.266952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:37.266641    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:24:37.738834 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:37.738801    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" event={"ID":"75abde56-5915-4269-bd2c-348b65b75858","Type":"ContainerStarted","Data":"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"}
Sep 11 19:24:37.739044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:37.738926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:38.745174 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:38.745139    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-4m6rf container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:24:38.745574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:38.745187    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" podUID="75abde56-5915-4269-bd2c-348b65b75858" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:24:41.744801 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:41.744762    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:41.773989 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:41.773924    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" podStartSLOduration=5.3369844 podStartE2EDuration="8.773903769s" totalImagesPullingTime="3.436919369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:37.765426272 +0000 UTC m=+400.298482414" watchObservedRunningTime="2026-09-11 19:24:41.773903769 +0000 UTC m=+404.306959891"
Sep 11 19:24:47.146066 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.146019    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"]
Sep 11 19:24:47.150850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.150828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.161883 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.161846    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 19:24:47.162251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.161915    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-5kx8x\""
Sep 11 19:24:47.194194 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.194161    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"]
Sep 11 19:24:47.196257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.196231    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"]
Sep 11 19:24:47.199982 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.199956    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.204352 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.204331    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 19:24:47.204646 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.204628    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4zw57\""
Sep 11 19:24:47.239195 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.239166    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.239374 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.239211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/409656b0-b5e9-479b-8532-241fd96dbbf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.239374 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.239237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb622\" (UniqueName: \"kubernetes.io/projected/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-kube-api-access-mb622\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.239482 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.239366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhqlf\" (UniqueName: \"kubernetes.io/projected/409656b0-b5e9-479b-8532-241fd96dbbf0-kube-api-access-zhqlf\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.245868 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.245839    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"]
Sep 11 19:24:47.340353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.340316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb622\" (UniqueName: \"kubernetes.io/projected/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-kube-api-access-mb622\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.340573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.340374    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhqlf\" (UniqueName: \"kubernetes.io/projected/409656b0-b5e9-479b-8532-241fd96dbbf0-kube-api-access-zhqlf\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.340573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.340407    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.340573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.340437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/409656b0-b5e9-479b-8532-241fd96dbbf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.340573 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:24:47.340537    2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 19:24:47.340741 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:24:47.340625    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert podName:5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98 nodeName:}" failed. No retries permitted until 2026-09-11 19:24:47.840605802 +0000 UTC m=+410.373661916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert") pod "kserve-controller-manager-d6f4b65b8-fhjff" (UID: "5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98") : secret "kserve-webhook-server-cert" not found
Sep 11 19:24:47.342930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.342906    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/409656b0-b5e9-479b-8532-241fd96dbbf0-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.362476 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.362448    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb622\" (UniqueName: \"kubernetes.io/projected/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-kube-api-access-mb622\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.368561 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.368523    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhqlf\" (UniqueName: \"kubernetes.io/projected/409656b0-b5e9-479b-8532-241fd96dbbf0-kube-api-access-zhqlf\") pod \"llmisvc-controller-manager-777c6bd7d5-wksv4\" (UID: \"409656b0-b5e9-479b-8532-241fd96dbbf0\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.510675 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.510569    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:47.785093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.785066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"]
Sep 11 19:24:47.787655 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:24:47.787621    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod409656b0_b5e9_479b_8532_241fd96dbbf0.slice/crio-697177aaacfd410e728ff5b50779c7138d2f7cdede9974c8f583d3144cf252ec WatchSource:0}: Error finding container 697177aaacfd410e728ff5b50779c7138d2f7cdede9974c8f583d3144cf252ec: Status 404 returned error can't find the container with id 697177aaacfd410e728ff5b50779c7138d2f7cdede9974c8f583d3144cf252ec
Sep 11 19:24:47.844824 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:47.844774    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:47.845017 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:24:47.844918    2562 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 19:24:47.845017 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:24:47.844982    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert podName:5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98 nodeName:}" failed. No retries permitted until 2026-09-11 19:24:48.844963306 +0000 UTC m=+411.378019405 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert") pod "kserve-controller-manager-d6f4b65b8-fhjff" (UID: "5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98") : secret "kserve-webhook-server-cert" not found
Sep 11 19:24:48.272761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.272723    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:48.273213 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.272923    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" podUID="75abde56-5915-4269-bd2c-348b65b75858" containerName="discovery" containerID="cri-o://e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5" gracePeriod=30
Sep 11 19:24:48.582399 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.582370    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:48.652408 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652380    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652408 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652480    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652502    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sksb7\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652557    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.652777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652582    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert\") pod \"75abde56-5915-4269-bd2c-348b65b75858\" (UID: \"75abde56-5915-4269-bd2c-348b65b75858\") "
Sep 11 19:24:48.653044 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.652896    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:24:48.655389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.655153    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts" (OuterVolumeSpecName: "cacerts") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:24:48.655389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.655277    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:24:48.655608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.655519    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:24:48.655680 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.655635    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token" (OuterVolumeSpecName: "istio-token") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:24:48.655756 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.655727    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs" (OuterVolumeSpecName: "local-certs") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:24:48.656157 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.656131    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7" (OuterVolumeSpecName: "kube-api-access-sksb7") pod "75abde56-5915-4269-bd2c-348b65b75858" (UID: "75abde56-5915-4269-bd2c-348b65b75858"). InnerVolumeSpecName "kube-api-access-sksb7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:24:48.753965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.753917    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-cacerts\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.753965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.753952    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.753965 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.753967    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-ca-configmap\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.754238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.753982    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-kubeconfig\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.754238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.753997    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sksb7\" (UniqueName: \"kubernetes.io/projected/75abde56-5915-4269-bd2c-348b65b75858-kube-api-access-sksb7\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.754238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.754010    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/75abde56-5915-4269-bd2c-348b65b75858-local-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.754238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.754022    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/75abde56-5915-4269-bd2c-348b65b75858-istio-csr-dns-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:24:48.794691 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.794647    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4" event={"ID":"409656b0-b5e9-479b-8532-241fd96dbbf0","Type":"ContainerStarted","Data":"697177aaacfd410e728ff5b50779c7138d2f7cdede9974c8f583d3144cf252ec"}
Sep 11 19:24:48.796371 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.796337    2562 generic.go:356] "Generic (PLEG): container finished" podID="75abde56-5915-4269-bd2c-348b65b75858" containerID="e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5" exitCode=0
Sep 11 19:24:48.796506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.796381    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" event={"ID":"75abde56-5915-4269-bd2c-348b65b75858","Type":"ContainerDied","Data":"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"}
Sep 11 19:24:48.796506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.796392    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"
Sep 11 19:24:48.796506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.796420    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf" event={"ID":"75abde56-5915-4269-bd2c-348b65b75858","Type":"ContainerDied","Data":"9f6e4eccb07dd2882f88a8f11f3eacd20d40aea7751248d27c89060595c4bba7"}
Sep 11 19:24:48.796506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.796450    2562 scope.go:117] "RemoveContainer" containerID="e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"
Sep 11 19:24:48.823339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.823310    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:48.825147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.825124    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-4m6rf"]
Sep 11 19:24:48.854960 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.854929    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:48.857441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.857412    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98-cert\") pod \"kserve-controller-manager-d6f4b65b8-fhjff\" (UID: \"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:48.939232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.939094    2562 scope.go:117] "RemoveContainer" containerID="e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"
Sep 11 19:24:48.941171 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:24:48.939958    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5\": container with ID starting with e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5 not found: ID does not exist" containerID="e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"
Sep 11 19:24:48.941171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.940003    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5"} err="failed to get container status \"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5\": rpc error: code = NotFound desc = could not find container \"e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5\": container with ID starting with e8b0fe9851b748e0afbeb03365b3d204651339e6c4b8a9301d297fbe8c11fea5 not found: ID does not exist"
Sep 11 19:24:48.975626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:48.975457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:49.492210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:49.492130    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"]
Sep 11 19:24:49.495240 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:24:49.495210    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ee92fbc_01e7_4f9b_bb59_1e8b7abdeb98.slice/crio-02c2bf933822d976ffd94f53cf840f86a8ddcd9607c7b5572a36d806a0f75f58 WatchSource:0}: Error finding container 02c2bf933822d976ffd94f53cf840f86a8ddcd9607c7b5572a36d806a0f75f58: Status 404 returned error can't find the container with id 02c2bf933822d976ffd94f53cf840f86a8ddcd9607c7b5572a36d806a0f75f58
Sep 11 19:24:49.801555 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:49.801440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff" event={"ID":"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98","Type":"ContainerStarted","Data":"02c2bf933822d976ffd94f53cf840f86a8ddcd9607c7b5572a36d806a0f75f58"}
Sep 11 19:24:49.978899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:49.978865    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75abde56-5915-4269-bd2c-348b65b75858" path="/var/lib/kubelet/pods/75abde56-5915-4269-bd2c-348b65b75858/volumes"
Sep 11 19:24:51.813715 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.813673    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff" event={"ID":"5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98","Type":"ContainerStarted","Data":"12a246c549a8e9dfc81798a2c1fa35a3c1ec605be9281d6ca861e1b273cb79b0"}
Sep 11 19:24:51.814170 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.813804    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:24:51.815338 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.815315    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4" event={"ID":"409656b0-b5e9-479b-8532-241fd96dbbf0","Type":"ContainerStarted","Data":"9a3f7d2296ca7ef6ad3a46f56f0fa24e6fde3dde856561109330858a2862d3a6"}
Sep 11 19:24:51.815460 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.815434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:24:51.831230 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.831186    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff" podStartSLOduration=2.602353637 podStartE2EDuration="4.83117255s" totalImagesPullingTime="2.228818913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:51.83074263 +0000 UTC m=+414.363798762" watchObservedRunningTime="2026-09-11 19:24:51.83117255 +0000 UTC m=+414.364228671"
Sep 11 19:24:51.850082 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:24:51.850035    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4" podStartSLOduration=1.8437158820000001 podStartE2EDuration="4.850017919s" totalImagesPullingTime="3.006302037s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:24:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:24:51.849748369 +0000 UTC m=+414.382804501" watchObservedRunningTime="2026-09-11 19:24:51.850017919 +0000 UTC m=+414.383074052"
Sep 11 19:25:22.821984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:22.821895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-wksv4"
Sep 11 19:25:22.825041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:22.825020    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-fhjff"
Sep 11 19:25:55.931202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.931166    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"]
Sep 11 19:25:55.931681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.931527    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75abde56-5915-4269-bd2c-348b65b75858" containerName="discovery"
Sep 11 19:25:55.931681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.931539    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="75abde56-5915-4269-bd2c-348b65b75858" containerName="discovery"
Sep 11 19:25:55.931681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.931622    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="75abde56-5915-4269-bd2c-348b65b75858" containerName="discovery"
Sep 11 19:25:55.934372 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.934353    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:25:55.937406 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.937376    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 19:25:55.937568 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.937489    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 19:25:55.937568 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.937499    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-xlpvm\""
Sep 11 19:25:55.939132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.939117    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 19:25:55.946786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.946765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"]
Sep 11 19:25:55.998912 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:55.998880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whsqm\" (UniqueName: \"kubernetes.io/projected/cd845113-ea4e-4423-8123-542fdcd9672d-kube-api-access-whsqm\") pod \"dns-operator-controller-manager-7b84cd7c9c-ldmm5\" (UID: \"cd845113-ea4e-4423-8123-542fdcd9672d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:25:56.099887 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:56.099852    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whsqm\" (UniqueName: \"kubernetes.io/projected/cd845113-ea4e-4423-8123-542fdcd9672d-kube-api-access-whsqm\") pod \"dns-operator-controller-manager-7b84cd7c9c-ldmm5\" (UID: \"cd845113-ea4e-4423-8123-542fdcd9672d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:25:56.108946 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:56.108922    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whsqm\" (UniqueName: \"kubernetes.io/projected/cd845113-ea4e-4423-8123-542fdcd9672d-kube-api-access-whsqm\") pod \"dns-operator-controller-manager-7b84cd7c9c-ldmm5\" (UID: \"cd845113-ea4e-4423-8123-542fdcd9672d\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:25:56.244439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:56.244358    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:25:56.520244 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:56.520179    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"]
Sep 11 19:25:56.522666 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:25:56.522632    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd845113_ea4e_4423_8123_542fdcd9672d.slice/crio-eb8ad1d73a826880d69c21702cfd1858cba559484f064425eabb4d05c3cbeaa5 WatchSource:0}: Error finding container eb8ad1d73a826880d69c21702cfd1858cba559484f064425eabb4d05c3cbeaa5: Status 404 returned error can't find the container with id eb8ad1d73a826880d69c21702cfd1858cba559484f064425eabb4d05c3cbeaa5
Sep 11 19:25:57.104435 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:57.104399    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5" event={"ID":"cd845113-ea4e-4423-8123-542fdcd9672d","Type":"ContainerStarted","Data":"eb8ad1d73a826880d69c21702cfd1858cba559484f064425eabb4d05c3cbeaa5"}
Sep 11 19:25:58.431770 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.431735    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vsdh6"]
Sep 11 19:25:58.441603 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.441530    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:25:58.444335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.444313    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-kxtp7\""
Sep 11 19:25:58.448635 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.448575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vsdh6"]
Sep 11 19:25:58.520300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.520259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n46rl\" (UniqueName: \"kubernetes.io/projected/deebe44a-eea2-4353-bd6a-03e9cf22368e-kube-api-access-n46rl\") pod \"authorino-operator-76b478bd78-vsdh6\" (UID: \"deebe44a-eea2-4353-bd6a-03e9cf22368e\") " pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:25:58.621527 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.621491    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n46rl\" (UniqueName: \"kubernetes.io/projected/deebe44a-eea2-4353-bd6a-03e9cf22368e-kube-api-access-n46rl\") pod \"authorino-operator-76b478bd78-vsdh6\" (UID: \"deebe44a-eea2-4353-bd6a-03e9cf22368e\") " pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:25:58.641211 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.641182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n46rl\" (UniqueName: \"kubernetes.io/projected/deebe44a-eea2-4353-bd6a-03e9cf22368e-kube-api-access-n46rl\") pod \"authorino-operator-76b478bd78-vsdh6\" (UID: \"deebe44a-eea2-4353-bd6a-03e9cf22368e\") " pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:25:58.755452 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:58.755362    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:25:59.068697 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:59.068672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 19:25:59.297157 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:25:59.297131    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-vsdh6"]
Sep 11 19:25:59.299596 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:25:59.299565    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddeebe44a_eea2_4353_bd6a_03e9cf22368e.slice/crio-ffee892fe595971d260f87686ef076be4380e2ce2909c4f3cb3e75044ee0f7fd WatchSource:0}: Error finding container ffee892fe595971d260f87686ef076be4380e2ce2909c4f3cb3e75044ee0f7fd: Status 404 returned error can't find the container with id ffee892fe595971d260f87686ef076be4380e2ce2909c4f3cb3e75044ee0f7fd
Sep 11 19:26:00.120532 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:00.120494    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6" event={"ID":"deebe44a-eea2-4353-bd6a-03e9cf22368e","Type":"ContainerStarted","Data":"ffee892fe595971d260f87686ef076be4380e2ce2909c4f3cb3e75044ee0f7fd"}
Sep 11 19:26:00.122147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:00.122122    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5" event={"ID":"cd845113-ea4e-4423-8123-542fdcd9672d","Type":"ContainerStarted","Data":"5703b83819ac4ecbd74598b9cc2ebeb9ecc16262b7f818700d10c17a8c0c1a85"}
Sep 11 19:26:00.122278 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:00.122259    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:26:00.144019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:00.143974    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5" podStartSLOduration=2.602854347 podStartE2EDuration="5.143959743s" totalImagesPullingTime="2.541105396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:00.142935777 +0000 UTC m=+482.675991908" watchObservedRunningTime="2026-09-11 19:26:00.143959743 +0000 UTC m=+482.677015864"
Sep 11 19:26:01.128882 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:01.128847    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6" event={"ID":"deebe44a-eea2-4353-bd6a-03e9cf22368e","Type":"ContainerStarted","Data":"b3357391bf8693cd63422c2bbfda74c509696cbd2a99f96f18aeaa545d22fb70"}
Sep 11 19:26:01.129237 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:01.129069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:26:01.149533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:01.149472    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6" podStartSLOduration=1.408081758 podStartE2EDuration="3.149450668s" totalImagesPullingTime="1.74136891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:01.148359572 +0000 UTC m=+483.681415695" watchObservedRunningTime="2026-09-11 19:26:01.149450668 +0000 UTC m=+483.682506790"
Sep 11 19:26:03.063490 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.063453    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"]
Sep 11 19:26:03.066907 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.066884    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.070468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.070446    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-rddbf\""
Sep 11 19:26:03.081340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.081305    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"]
Sep 11 19:26:03.159955 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.159921    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5h2c\" (UniqueName: \"kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.160169 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.159959    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.261269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.261229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5h2c\" (UniqueName: \"kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.261269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.261270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.261654 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.261638    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.278608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.278576    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5h2c\" (UniqueName: \"kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c\") pod \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.377004 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.376968    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:03.652513 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:03.652486    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"]
Sep 11 19:26:03.655365 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:03.655335    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128a7e87_c118_42cd_8978_0708572c9146.slice/crio-a3329e2d920c7c342f0de2066f05fee46b0d1d9a2fca6da3a3a40c04f7b82157 WatchSource:0}: Error finding container a3329e2d920c7c342f0de2066f05fee46b0d1d9a2fca6da3a3a40c04f7b82157: Status 404 returned error can't find the container with id a3329e2d920c7c342f0de2066f05fee46b0d1d9a2fca6da3a3a40c04f7b82157
Sep 11 19:26:04.146618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:04.146578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s" event={"ID":"128a7e87-c118-42cd-8978-0708572c9146","Type":"ContainerStarted","Data":"a3329e2d920c7c342f0de2066f05fee46b0d1d9a2fca6da3a3a40c04f7b82157"}
Sep 11 19:26:05.198103 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.198072    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"]
Sep 11 19:26:05.201690 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.201661    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:05.206488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.206458    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f7kgs\""
Sep 11 19:26:05.215221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.215193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"]
Sep 11 19:26:05.278721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.278686    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz42g\" (UniqueName: \"kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g\") pod \"limitador-operator-controller-manager-74495c69f8-r2nmg\" (UID: \"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:05.379953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.379917    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz42g\" (UniqueName: \"kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g\") pod \"limitador-operator-controller-manager-74495c69f8-r2nmg\" (UID: \"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:05.391898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.391861    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz42g\" (UniqueName: \"kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g\") pod \"limitador-operator-controller-manager-74495c69f8-r2nmg\" (UID: \"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:05.515063 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.514967    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:05.803671 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:05.803630    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8b2613_0dde_4ff7_8fab_d6bbd6e3398a.slice/crio-c418b0c5088cc907641a5d8b4d5b0d3e5fa25f58bdecaa26cedd0b85daf494e2 WatchSource:0}: Error finding container c418b0c5088cc907641a5d8b4d5b0d3e5fa25f58bdecaa26cedd0b85daf494e2: Status 404 returned error can't find the container with id c418b0c5088cc907641a5d8b4d5b0d3e5fa25f58bdecaa26cedd0b85daf494e2
Sep 11 19:26:05.804624 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:05.804462    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"]
Sep 11 19:26:06.161731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:06.161686    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg" event={"ID":"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a","Type":"ContainerStarted","Data":"c418b0c5088cc907641a5d8b4d5b0d3e5fa25f58bdecaa26cedd0b85daf494e2"}
Sep 11 19:26:08.173901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:08.173863    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s" event={"ID":"128a7e87-c118-42cd-8978-0708572c9146","Type":"ContainerStarted","Data":"357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc"}
Sep 11 19:26:08.174268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:08.174001    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:08.198383 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:08.198327    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s" podStartSLOduration=1.449376301 podStartE2EDuration="5.198307447s" totalImagesPullingTime="3.748931146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:08.196036011 +0000 UTC m=+490.729092152" watchObservedRunningTime="2026-09-11 19:26:08.198307447 +0000 UTC m=+490.731363570"
Sep 11 19:26:09.180147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:09.180102    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg" event={"ID":"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a","Type":"ContainerStarted","Data":"62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8"}
Sep 11 19:26:09.197226 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:09.197179    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg" podStartSLOduration=1.818181193 podStartE2EDuration="4.197163031s" totalImagesPullingTime="2.378981838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:09.196760305 +0000 UTC m=+491.729816426" watchObservedRunningTime="2026-09-11 19:26:09.197163031 +0000 UTC m=+491.730219151"
Sep 11 19:26:10.185781 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:10.185746    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:11.131374 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:11.131342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-ldmm5"
Sep 11 19:26:12.136219 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:12.136189    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-vsdh6"
Sep 11 19:26:19.182613 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:19.182583    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.190479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.190427    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"]
Sep 11 19:26:21.194713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.194679    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.195479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.195460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.214418 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.214378    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"]
Sep 11 19:26:21.297201 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.297165    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"]
Sep 11 19:26:21.297400 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.297379    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s" podUID="128a7e87-c118-42cd-8978-0708572c9146" containerName="manager" containerID="cri-o://357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc" gracePeriod=2
Sep 11 19:26:21.304870 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.304842    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"]
Sep 11 19:26:21.305225 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.305197    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-fwvvv], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" podUID="dac7f00f-b799-4dcd-aada-e3d20f7b5532"
Sep 11 19:26:21.311620 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.311588    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"]
Sep 11 19:26:21.317283 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.317256    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.317417 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.317307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwvvv\" (UniqueName: \"kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.323824 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.323796    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"]
Sep 11 19:26:21.334312 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.334279    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"128a7e87-c118-42cd-8978-0708572c9146\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\": pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.336829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.336804    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"]
Sep 11 19:26:21.359813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.359780    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"]
Sep 11 19:26:21.360003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.359981    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" containerName="manager" containerID="cri-o://62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8" gracePeriod=2
Sep 11 19:26:21.362284 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.362241    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="128a7e87-c118-42cd-8978-0708572c9146" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.369851 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.369771    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"]
Sep 11 19:26:21.371715 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.371691    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:26:21.372147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372128    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="128a7e87-c118-42cd-8978-0708572c9146" containerName="manager"
Sep 11 19:26:21.372147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372149    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="128a7e87-c118-42cd-8978-0708572c9146" containerName="manager"
Sep 11 19:26:21.372292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372181    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" containerName="manager"
Sep 11 19:26:21.372292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372190    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" containerName="manager"
Sep 11 19:26:21.372292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372274    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" containerName="manager"
Sep 11 19:26:21.372292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.372289    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="128a7e87-c118-42cd-8978-0708572c9146" containerName="manager"
Sep 11 19:26:21.377333 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.377313    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.399350 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.399317    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:26:21.401472 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.401446    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"]
Sep 11 19:26:21.405182 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.405159    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:21.416584 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.416528    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"]
Sep 11 19:26:21.417380 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.417348    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="128a7e87-c118-42cd-8978-0708572c9146" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.418479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.418001    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.418479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.418055    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvvv\" (UniqueName: \"kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.418657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.418595    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:21.421654 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.421624    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r2nmg\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.424022 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.424002    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fwvvv for pod kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd: failed to fetch token: pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" not found
Sep 11 19:26:21.424127 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.424077    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv podName:dac7f00f-b799-4dcd-aada-e3d20f7b5532 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:21.924059507 +0000 UTC m=+504.457115621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fwvvv" (UniqueName: "kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv") pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" (UID: "dac7f00f-b799-4dcd-aada-e3d20f7b5532") : failed to fetch token: pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" not found
Sep 11 19:26:21.447778 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.447691    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="128a7e87-c118-42cd-8978-0708572c9146" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.450025 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.449997    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r2nmg\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.518639 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.518597    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ndccv\" (UniqueName: \"kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.518802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.518663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wdln\" (UniqueName: \"kubernetes.io/projected/19f6bdd1-7a37-4959-bc8d-7afbf8af98c3-kube-api-access-5wdln\") pod \"limitador-operator-controller-manager-74495c69f8-ct85m\" (UID: \"19f6bdd1-7a37-4959-bc8d-7afbf8af98c3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:21.518802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.518770    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.605233 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.605209    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.608014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.607990    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.608119 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.608003    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="128a7e87-c118-42cd-8978-0708572c9146" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.616699 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.616669    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r2nmg\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.619953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.619928    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.620040 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.619975    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ndccv\" (UniqueName: \"kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.620105 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.620036    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wdln\" (UniqueName: \"kubernetes.io/projected/19f6bdd1-7a37-4959-bc8d-7afbf8af98c3-kube-api-access-5wdln\") pod \"limitador-operator-controller-manager-74495c69f8-ct85m\" (UID: \"19f6bdd1-7a37-4959-bc8d-7afbf8af98c3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:21.620294 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.620276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.625689 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.625665    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-gbm5s\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="128a7e87-c118-42cd-8978-0708572c9146" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:21.628647 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:21.628628    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-r2nmg\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:21.642895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.642875    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ndccv\" (UniqueName: \"kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv\") pod \"kuadrant-operator-controller-manager-5769f99d9f-wpm6d\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.643228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.643211    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wdln\" (UniqueName: \"kubernetes.io/projected/19f6bdd1-7a37-4959-bc8d-7afbf8af98c3-kube-api-access-5wdln\") pod \"limitador-operator-controller-manager-74495c69f8-ct85m\" (UID: \"19f6bdd1-7a37-4959-bc8d-7afbf8af98c3\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:21.720789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.720700    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume\") pod \"128a7e87-c118-42cd-8978-0708572c9146\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") "
Sep 11 19:26:21.720789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.720785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kz42g\" (UniqueName: \"kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g\") pod \"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a\" (UID: \"0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a\") "
Sep 11 19:26:21.720998 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.720861    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5h2c\" (UniqueName: \"kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c\") pod \"128a7e87-c118-42cd-8978-0708572c9146\" (UID: \"128a7e87-c118-42cd-8978-0708572c9146\") "
Sep 11 19:26:21.721274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.721248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "128a7e87-c118-42cd-8978-0708572c9146" (UID: "128a7e87-c118-42cd-8978-0708572c9146"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:26:21.722967 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.722944    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g" (OuterVolumeSpecName: "kube-api-access-kz42g") pod "0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" (UID: "0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a"). InnerVolumeSpecName "kube-api-access-kz42g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:26:21.723051 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.723003    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c" (OuterVolumeSpecName: "kube-api-access-s5h2c") pod "128a7e87-c118-42cd-8978-0708572c9146" (UID: "128a7e87-c118-42cd-8978-0708572c9146"). InnerVolumeSpecName "kube-api-access-s5h2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:26:21.725465 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.725447    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:21.732589 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.732561    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:21.822226 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.822198    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5h2c\" (UniqueName: \"kubernetes.io/projected/128a7e87-c118-42cd-8978-0708572c9146-kube-api-access-s5h2c\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:26:21.822226 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.822223    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/128a7e87-c118-42cd-8978-0708572c9146-extensions-socket-volume\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:26:21.822226 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.822236    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz42g\" (UniqueName: \"kubernetes.io/projected/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a-kube-api-access-kz42g\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:26:21.979323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.979247    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" path="/var/lib/kubelet/pods/0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a/volumes"
Sep 11 19:26:21.979762 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:21.979746    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="128a7e87-c118-42cd-8978-0708572c9146" path="/var/lib/kubelet/pods/128a7e87-c118-42cd-8978-0708572c9146/volumes"
Sep 11 19:26:22.010615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.010586    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:26:22.012911 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:22.012870    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09d9b9a2_252a_4b91_b34a_7ed0fa5f1e63.slice/crio-65b8ad29f9e9b44a1939e064c9d3bae836aa3eb995ff2d237490bcb180f37eb0 WatchSource:0}: Error finding container 65b8ad29f9e9b44a1939e064c9d3bae836aa3eb995ff2d237490bcb180f37eb0: Status 404 returned error can't find the container with id 65b8ad29f9e9b44a1939e064c9d3bae836aa3eb995ff2d237490bcb180f37eb0
Sep 11 19:26:22.013628 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.013607    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"]
Sep 11 19:26:22.015344 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:22.015316    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f6bdd1_7a37_4959_bc8d_7afbf8af98c3.slice/crio-b7f8d1393b16deddbca55b0019e81ab1683b6ac62e2e1840773b53bd28af2d7c WatchSource:0}: Error finding container b7f8d1393b16deddbca55b0019e81ab1683b6ac62e2e1840773b53bd28af2d7c: Status 404 returned error can't find the container with id b7f8d1393b16deddbca55b0019e81ab1683b6ac62e2e1840773b53bd28af2d7c
Sep 11 19:26:22.023909 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.023888    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwvvv\" (UniqueName: \"kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv\") pod \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") " pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:22.027220 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:22.027198    2562 projected.go:196] Error preparing data for projected volume kube-api-access-fwvvv for pod kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd: failed to fetch token: pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" not found
Sep 11 19:26:22.027314 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:22.027266    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv podName:dac7f00f-b799-4dcd-aada-e3d20f7b5532 nodeName:}" failed. No retries permitted until 2026-09-11 19:26:23.027235349 +0000 UTC m=+505.560291450 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fwvvv" (UniqueName: "kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv") pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" (UID: "dac7f00f-b799-4dcd-aada-e3d20f7b5532") : failed to fetch token: pod "kuadrant-operator-controller-manager-7978cbdfbc-b4bdd" not found
Sep 11 19:26:22.253904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.253798    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m" event={"ID":"19f6bdd1-7a37-4959-bc8d-7afbf8af98c3","Type":"ContainerStarted","Data":"300edef0efb4d4d922189a73b1aa2ed19ab0d2359ba5450cdc25b2bf818a7b7f"}
Sep 11 19:26:22.253904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.253869    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m" event={"ID":"19f6bdd1-7a37-4959-bc8d-7afbf8af98c3","Type":"ContainerStarted","Data":"b7f8d1393b16deddbca55b0019e81ab1683b6ac62e2e1840773b53bd28af2d7c"}
Sep 11 19:26:22.253904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.253898    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:22.255399 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.255372    2562 generic.go:356] "Generic (PLEG): container finished" podID="128a7e87-c118-42cd-8978-0708572c9146" containerID="357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc" exitCode=0
Sep 11 19:26:22.255574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.255416    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-gbm5s"
Sep 11 19:26:22.255574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.255459    2562 scope.go:117] "RemoveContainer" containerID="357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc"
Sep 11 19:26:22.257479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.257429    2562 generic.go:356] "Generic (PLEG): container finished" podID="0e8b2613-0dde-4ff7-8fab-d6bbd6e3398a" containerID="62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8" exitCode=0
Sep 11 19:26:22.257608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.257517    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-r2nmg"
Sep 11 19:26:22.259745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.259723    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:22.259964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.259892    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" event={"ID":"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63","Type":"ContainerStarted","Data":"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"}
Sep 11 19:26:22.259964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.259956    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:22.260090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.259977    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" event={"ID":"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63","Type":"ContainerStarted","Data":"65b8ad29f9e9b44a1939e064c9d3bae836aa3eb995ff2d237490bcb180f37eb0"}
Sep 11 19:26:22.266366 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.266347    2562 scope.go:117] "RemoveContainer" containerID="357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc"
Sep 11 19:26:22.266823 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:22.266791    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc\": container with ID starting with 357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc not found: ID does not exist" containerID="357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc"
Sep 11 19:26:22.266912 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.266836    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc"} err="failed to get container status \"357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc\": rpc error: code = NotFound desc = could not find container \"357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc\": container with ID starting with 357c9ed7312dbead34efe5c9c3ce486c40370f3060d0023f674afb2a29ddcdbc not found: ID does not exist"
Sep 11 19:26:22.266912 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.266860    2562 scope.go:117] "RemoveContainer" containerID="62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8"
Sep 11 19:26:22.269060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.269042    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:22.276196 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.276147    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m" podStartSLOduration=1.276130575 podStartE2EDuration="1.276130575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:22.275715222 +0000 UTC m=+504.808771363" watchObservedRunningTime="2026-09-11 19:26:22.276130575 +0000 UTC m=+504.809186754"
Sep 11 19:26:22.276537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.276483    2562 scope.go:117] "RemoveContainer" containerID="62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8"
Sep 11 19:26:22.276957 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:22.276937    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8\": container with ID starting with 62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8 not found: ID does not exist" containerID="62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8"
Sep 11 19:26:22.277039 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.276963    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8"} err="failed to get container status \"62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8\": rpc error: code = NotFound desc = could not find container \"62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8\": container with ID starting with 62e9d4ff03e4db541589e3cdb567f36d42f7e5bfb9248b2885d5406e28a13ee8 not found: ID does not exist"
Sep 11 19:26:22.300226 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.300175    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" podStartSLOduration=1.300161633 podStartE2EDuration="1.300161633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:22.299671868 +0000 UTC m=+504.832728009" watchObservedRunningTime="2026-09-11 19:26:22.300161633 +0000 UTC m=+504.833217753"
Sep 11 19:26:22.302024 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:22.301998    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="dac7f00f-b799-4dcd-aada-e3d20f7b5532" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:22.425883 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.425846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume\") pod \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\" (UID: \"dac7f00f-b799-4dcd-aada-e3d20f7b5532\") "
Sep 11 19:26:22.426066 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.426049    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwvvv\" (UniqueName: \"kubernetes.io/projected/dac7f00f-b799-4dcd-aada-e3d20f7b5532-kube-api-access-fwvvv\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:26:22.426147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.426112    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dac7f00f-b799-4dcd-aada-e3d20f7b5532" (UID: "dac7f00f-b799-4dcd-aada-e3d20f7b5532"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:26:22.526687 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:22.526586    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dac7f00f-b799-4dcd-aada-e3d20f7b5532-extensions-socket-volume\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:26:23.267858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:23.267828    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:23.270162 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:23.270138    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="dac7f00f-b799-4dcd-aada-e3d20f7b5532" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:23.281049 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:26:23.281018    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-7978cbdfbc-b4bdd\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="dac7f00f-b799-4dcd-aada-e3d20f7b5532" pod="kuadrant-system/kuadrant-operator-controller-manager-7978cbdfbc-b4bdd"
Sep 11 19:26:23.978522 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:23.978486    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dac7f00f-b799-4dcd-aada-e3d20f7b5532" path="/var/lib/kubelet/pods/dac7f00f-b799-4dcd-aada-e3d20f7b5532/volumes"
Sep 11 19:26:33.270197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:33.270164    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:26:33.270735 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:33.270232    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-ct85m"
Sep 11 19:26:52.262483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.262393    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:26:52.266004 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.265982    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.268377 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.268351    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 19:26:52.268516 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.268362    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-z9kkf\""
Sep 11 19:26:52.275558 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.275519    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:26:52.311351 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.311315    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:26:52.367681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.367649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxs7\" (UniqueName: \"kubernetes.io/projected/47328f6b-8949-47d2-83fd-7e810dd818b5-kube-api-access-8gxs7\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.367847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.367713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47328f6b-8949-47d2-83fd-7e810dd818b5-config-file\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.468555 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.468521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxs7\" (UniqueName: \"kubernetes.io/projected/47328f6b-8949-47d2-83fd-7e810dd818b5-kube-api-access-8gxs7\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.468759 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.468586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47328f6b-8949-47d2-83fd-7e810dd818b5-config-file\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.469197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.469177    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/47328f6b-8949-47d2-83fd-7e810dd818b5-config-file\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.476758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.476730    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxs7\" (UniqueName: \"kubernetes.io/projected/47328f6b-8949-47d2-83fd-7e810dd818b5-kube-api-access-8gxs7\") pod \"limitador-limitador-84994f7ffc-vv9zm\" (UID: \"47328f6b-8949-47d2-83fd-7e810dd818b5\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.577787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.577754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:52.825358 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.825325    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:26:52.829794 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.829728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:26:52.832161 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.832136    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nhrtd\""
Sep 11 19:26:52.835619 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.835599    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:26:52.849802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.849779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:26:52.851329 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:52.851301    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47328f6b_8949_47d2_83fd_7e810dd818b5.slice/crio-0838681fec146b2da6e032867bc4a4e5be2b0acb2cb9ce782ed24381ddb00aac WatchSource:0}: Error finding container 0838681fec146b2da6e032867bc4a4e5be2b0acb2cb9ce782ed24381ddb00aac: Status 404 returned error can't find the container with id 0838681fec146b2da6e032867bc4a4e5be2b0acb2cb9ce782ed24381ddb00aac
Sep 11 19:26:52.872124 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.872100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx78z\" (UniqueName: \"kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z\") pod \"authorino-59c974bd48-pbppr\" (UID: \"5c5b404a-417a-4d50-8ced-5cf8ff680202\") " pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:26:52.973217 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.973182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cx78z\" (UniqueName: \"kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z\") pod \"authorino-59c974bd48-pbppr\" (UID: \"5c5b404a-417a-4d50-8ced-5cf8ff680202\") " pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:26:52.981430 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:52.981399    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx78z\" (UniqueName: \"kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z\") pod \"authorino-59c974bd48-pbppr\" (UID: \"5c5b404a-417a-4d50-8ced-5cf8ff680202\") " pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:26:53.139668 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:53.139587    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:26:53.408485 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:53.408459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:26:53.410284 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:26:53.410258    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c5b404a_417a_4d50_8ced_5cf8ff680202.slice/crio-3e68e8b5b884424e2b9a38be7030c203984680123f4d86f5f1176b2653572eea WatchSource:0}: Error finding container 3e68e8b5b884424e2b9a38be7030c203984680123f4d86f5f1176b2653572eea: Status 404 returned error can't find the container with id 3e68e8b5b884424e2b9a38be7030c203984680123f4d86f5f1176b2653572eea
Sep 11 19:26:53.411223 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:53.411199    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm" event={"ID":"47328f6b-8949-47d2-83fd-7e810dd818b5","Type":"ContainerStarted","Data":"0838681fec146b2da6e032867bc4a4e5be2b0acb2cb9ce782ed24381ddb00aac"}
Sep 11 19:26:54.416713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:54.416671    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-pbppr" event={"ID":"5c5b404a-417a-4d50-8ced-5cf8ff680202","Type":"ContainerStarted","Data":"3e68e8b5b884424e2b9a38be7030c203984680123f4d86f5f1176b2653572eea"}
Sep 11 19:26:54.418161 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:54.418136    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm" event={"ID":"47328f6b-8949-47d2-83fd-7e810dd818b5","Type":"ContainerStarted","Data":"7ec6a0be9439b677888d4ff9f9ed49119f981c67682ed26dea9430b79959eebb"}
Sep 11 19:26:54.418293 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:54.418198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:26:54.434360 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:54.434317    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm" podStartSLOduration=1.322594311 podStartE2EDuration="2.434304604s" totalImagesPullingTime="1.111710293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:54.433368591 +0000 UTC m=+536.966424731" watchObservedRunningTime="2026-09-11 19:26:54.434304604 +0000 UTC m=+536.967360722"
Sep 11 19:26:56.430117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:56.430074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-pbppr" event={"ID":"5c5b404a-417a-4d50-8ced-5cf8ff680202","Type":"ContainerStarted","Data":"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"}
Sep 11 19:26:56.448075 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:26:56.448020    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-pbppr" podStartSLOduration=2.283532745 podStartE2EDuration="4.448005652s" totalImagesPullingTime="2.164472907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:26:56.44492692 +0000 UTC m=+538.977983043" watchObservedRunningTime="2026-09-11 19:26:56.448005652 +0000 UTC m=+538.981061772"
Sep 11 19:27:05.425232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:05.425198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"
Sep 11 19:27:18.383032 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.382999    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:18.388104 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.388080    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:18.392827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.392799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:18.395117 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.395088    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clvql\" (UniqueName: \"kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql\") pod \"authorino-557f876f69-zpqcn\" (UID: \"5f3d80f1-e7e6-437e-9d3d-3842da78b164\") " pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:18.496069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.496030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clvql\" (UniqueName: \"kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql\") pod \"authorino-557f876f69-zpqcn\" (UID: \"5f3d80f1-e7e6-437e-9d3d-3842da78b164\") " pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:18.503998 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.503959    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clvql\" (UniqueName: \"kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql\") pod \"authorino-557f876f69-zpqcn\" (UID: \"5f3d80f1-e7e6-437e-9d3d-3842da78b164\") " pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:18.513530 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.513496    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:18.513756 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.513740    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:18.543304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.543271    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-csl7r"]
Sep 11 19:27:18.547978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.547954    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.550471 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.550432    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 19:27:18.553317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.553292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-csl7r"]
Sep 11 19:27:18.596827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.596799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v798\" (UniqueName: \"kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.596964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.596837    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.609615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.609586    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-csl7r"]
Sep 11 19:27:18.609918 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:27:18.609892    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2v798 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-csl7r" podUID="db074346-594e-48c0-b70e-6eb37c0304ae"
Sep 11 19:27:18.697478 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.697395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v798\" (UniqueName: \"kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.697478 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.697438    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.699867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.699838    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.705261 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.705238    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v798\" (UniqueName: \"kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798\") pod \"authorino-6d4dfc649f-csl7r\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") " pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:18.793347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:18.793323    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:18.795305 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:27:18.795279    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5f3d80f1_e7e6_437e_9d3d_3842da78b164.slice/crio-1d45c0a430892d93ebc581d0709e48dc4b3a1fc9ef847ec0ff09723ba0e839f1 WatchSource:0}: Error finding container 1d45c0a430892d93ebc581d0709e48dc4b3a1fc9ef847ec0ff09723ba0e839f1: Status 404 returned error can't find the container with id 1d45c0a430892d93ebc581d0709e48dc4b3a1fc9ef847ec0ff09723ba0e839f1
Sep 11 19:27:19.539848 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.539761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zpqcn" event={"ID":"5f3d80f1-e7e6-437e-9d3d-3842da78b164","Type":"ContainerStarted","Data":"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"}
Sep 11 19:27:19.539848 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.539807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zpqcn" event={"ID":"5f3d80f1-e7e6-437e-9d3d-3842da78b164","Type":"ContainerStarted","Data":"1d45c0a430892d93ebc581d0709e48dc4b3a1fc9ef847ec0ff09723ba0e839f1"}
Sep 11 19:27:19.540338 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.539841    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-557f876f69-zpqcn" podUID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" containerName="authorino" containerID="cri-o://87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62" gracePeriod=30
Sep 11 19:27:19.540338 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.539852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:19.548223 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.548199    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:19.556474 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.556436    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-557f876f69-zpqcn" podStartSLOduration=1.1775977499999999 podStartE2EDuration="1.556422511s" totalImagesPullingTime="378.824761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:27:19.555828123 +0000 UTC m=+562.088884246" watchObservedRunningTime="2026-09-11 19:27:19.556422511 +0000 UTC m=+562.089478632"
Sep 11 19:27:19.604450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.604422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2v798\" (UniqueName: \"kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798\") pod \"db074346-594e-48c0-b70e-6eb37c0304ae\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") "
Sep 11 19:27:19.604600 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.604455    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert\") pod \"db074346-594e-48c0-b70e-6eb37c0304ae\" (UID: \"db074346-594e-48c0-b70e-6eb37c0304ae\") "
Sep 11 19:27:19.606525 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.606501    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "db074346-594e-48c0-b70e-6eb37c0304ae" (UID: "db074346-594e-48c0-b70e-6eb37c0304ae"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:27:19.606633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.606600    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798" (OuterVolumeSpecName: "kube-api-access-2v798") pod "db074346-594e-48c0-b70e-6eb37c0304ae" (UID: "db074346-594e-48c0-b70e-6eb37c0304ae"). InnerVolumeSpecName "kube-api-access-2v798". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:27:19.705069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.705043    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2v798\" (UniqueName: \"kubernetes.io/projected/db074346-594e-48c0-b70e-6eb37c0304ae-kube-api-access-2v798\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:27:19.705069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.705069    2562 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/db074346-594e-48c0-b70e-6eb37c0304ae-tls-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:27:19.787276 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.787250    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:19.805522 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.805438    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clvql\" (UniqueName: \"kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql\") pod \"5f3d80f1-e7e6-437e-9d3d-3842da78b164\" (UID: \"5f3d80f1-e7e6-437e-9d3d-3842da78b164\") "
Sep 11 19:27:19.807672 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.807644    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql" (OuterVolumeSpecName: "kube-api-access-clvql") pod "5f3d80f1-e7e6-437e-9d3d-3842da78b164" (UID: "5f3d80f1-e7e6-437e-9d3d-3842da78b164"). InnerVolumeSpecName "kube-api-access-clvql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:27:19.904367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.904334    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:27:19.904528 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.904508    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-pbppr" podUID="5c5b404a-417a-4d50-8ced-5cf8ff680202" containerName="authorino" containerID="cri-o://317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa" gracePeriod=30
Sep 11 19:27:19.906297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:19.906270    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clvql\" (UniqueName: \"kubernetes.io/projected/5f3d80f1-e7e6-437e-9d3d-3842da78b164-kube-api-access-clvql\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:27:20.155026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.154999    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:27:20.208771 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.208744    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cx78z\" (UniqueName: \"kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z\") pod \"5c5b404a-417a-4d50-8ced-5cf8ff680202\" (UID: \"5c5b404a-417a-4d50-8ced-5cf8ff680202\") "
Sep 11 19:27:20.210843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.210813    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z" (OuterVolumeSpecName: "kube-api-access-cx78z") pod "5c5b404a-417a-4d50-8ced-5cf8ff680202" (UID: "5c5b404a-417a-4d50-8ced-5cf8ff680202"). InnerVolumeSpecName "kube-api-access-cx78z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:27:20.309285 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.309243    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cx78z\" (UniqueName: \"kubernetes.io/projected/5c5b404a-417a-4d50-8ced-5cf8ff680202-kube-api-access-cx78z\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:27:20.545224 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.545191    2562 generic.go:356] "Generic (PLEG): container finished" podID="5c5b404a-417a-4d50-8ced-5cf8ff680202" containerID="317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa" exitCode=0
Sep 11 19:27:20.545644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.545232    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-pbppr"
Sep 11 19:27:20.545644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.545272    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-pbppr" event={"ID":"5c5b404a-417a-4d50-8ced-5cf8ff680202","Type":"ContainerDied","Data":"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"}
Sep 11 19:27:20.545644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.545324    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-pbppr" event={"ID":"5c5b404a-417a-4d50-8ced-5cf8ff680202","Type":"ContainerDied","Data":"3e68e8b5b884424e2b9a38be7030c203984680123f4d86f5f1176b2653572eea"}
Sep 11 19:27:20.545644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.545349    2562 scope.go:117] "RemoveContainer" containerID="317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"
Sep 11 19:27:20.546776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.546757    2562 generic.go:356] "Generic (PLEG): container finished" podID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" containerID="87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62" exitCode=0
Sep 11 19:27:20.546867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.546791    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zpqcn" event={"ID":"5f3d80f1-e7e6-437e-9d3d-3842da78b164","Type":"ContainerDied","Data":"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"}
Sep 11 19:27:20.546867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.546814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-zpqcn"
Sep 11 19:27:20.546867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.546833    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-557f876f69-zpqcn" event={"ID":"5f3d80f1-e7e6-437e-9d3d-3842da78b164","Type":"ContainerDied","Data":"1d45c0a430892d93ebc581d0709e48dc4b3a1fc9ef847ec0ff09723ba0e839f1"}
Sep 11 19:27:20.546867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.546837    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-csl7r"
Sep 11 19:27:20.555459 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.555445    2562 scope.go:117] "RemoveContainer" containerID="317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"
Sep 11 19:27:20.555733 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:27:20.555713    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa\": container with ID starting with 317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa not found: ID does not exist" containerID="317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"
Sep 11 19:27:20.555788 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.555740    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa"} err="failed to get container status \"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa\": rpc error: code = NotFound desc = could not find container \"317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa\": container with ID starting with 317e6ea4d382ad87c1689fd59b283346d494da0740c2ec1a0d42fc11e88d9bfa not found: ID does not exist"
Sep 11 19:27:20.555788 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.555756    2562 scope.go:117] "RemoveContainer" containerID="87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"
Sep 11 19:27:20.563465 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.563449    2562 scope.go:117] "RemoveContainer" containerID="87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"
Sep 11 19:27:20.563723 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:27:20.563706    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62\": container with ID starting with 87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62 not found: ID does not exist" containerID="87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"
Sep 11 19:27:20.563778 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.563730    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62"} err="failed to get container status \"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62\": rpc error: code = NotFound desc = could not find container \"87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62\": container with ID starting with 87c55d9ab8774ce9dc3cf84765978bd0994761c4204032bfc69925a8d122eb62 not found: ID does not exist"
Sep 11 19:27:20.576747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.576727    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-csl7r"]
Sep 11 19:27:20.580455 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.580431    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-csl7r"]
Sep 11 19:27:20.589984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.589961    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:20.591350 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.591333    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-zpqcn"]
Sep 11 19:27:20.600556 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.600525    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:27:20.603918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:20.603901    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-pbppr"]
Sep 11 19:27:21.979106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:21.979075    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c5b404a-417a-4d50-8ced-5cf8ff680202" path="/var/lib/kubelet/pods/5c5b404a-417a-4d50-8ced-5cf8ff680202/volumes"
Sep 11 19:27:21.979469 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:21.979421    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" path="/var/lib/kubelet/pods/5f3d80f1-e7e6-437e-9d3d-3842da78b164/volumes"
Sep 11 19:27:21.979806 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:21.979791    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db074346-594e-48c0-b70e-6eb37c0304ae" path="/var/lib/kubelet/pods/db074346-594e-48c0-b70e-6eb37c0304ae/volumes"
Sep 11 19:27:57.921889 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:57.921863    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:27:57.922398 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:27:57.921864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:28:02.363612 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:02.363575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:28:26.006967 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.006890    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"]
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c5b404a-417a-4d50-8ced-5cf8ff680202" containerName="authorino"
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007251    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c5b404a-417a-4d50-8ced-5cf8ff680202" containerName="authorino"
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007277    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" containerName="authorino"
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007283    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" containerName="authorino"
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007341    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c5b404a-417a-4d50-8ced-5cf8ff680202" containerName="authorino"
Sep 11 19:28:26.007388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.007350    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f3d80f1-e7e6-437e-9d3d-3842da78b164" containerName="authorino"
Sep 11 19:28:26.010296 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.010276    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.013662 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.013636    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 19:28:26.013783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.013672    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 19:28:26.013783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.013687    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 19:28:26.013783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.013715    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-phcxt\""
Sep 11 19:28:26.018188 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.018166    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"]
Sep 11 19:28:26.045981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.045952    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.046153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.045994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.046153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.046090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7b580d-0125-4d34-9146-c62749760b8e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.046153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.046132    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.046328 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.046188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.046328 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.046251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh452\" (UniqueName: \"kubernetes.io/projected/2d7b580d-0125-4d34-9146-c62749760b8e-kube-api-access-wh452\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.147736 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7b580d-0125-4d34-9146-c62749760b8e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.147935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.147935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.147935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh452\" (UniqueName: \"kubernetes.io/projected/2d7b580d-0125-4d34-9146-c62749760b8e-kube-api-access-wh452\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.147935 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.148147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.147941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.148261 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.148235    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.148319 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.148276    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.148578 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.148524    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.150530 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.150506    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d7b580d-0125-4d34-9146-c62749760b8e-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.150691 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.150670    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2d7b580d-0125-4d34-9146-c62749760b8e-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.156264 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.156239    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh452\" (UniqueName: \"kubernetes.io/projected/2d7b580d-0125-4d34-9146-c62749760b8e-kube-api-access-wh452\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896\" (UID: \"2d7b580d-0125-4d34-9146-c62749760b8e\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.321687 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.321592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:26.602231 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.602206    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"]
Sep 11 19:28:26.604931 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:28:26.604904    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d7b580d_0125_4d34_9146_c62749760b8e.slice/crio-533880624cbd2fce1cf210a5e231a576e62526e47739b801d9850eee2a5c7c02 WatchSource:0}: Error finding container 533880624cbd2fce1cf210a5e231a576e62526e47739b801d9850eee2a5c7c02: Status 404 returned error can't find the container with id 533880624cbd2fce1cf210a5e231a576e62526e47739b801d9850eee2a5c7c02
Sep 11 19:28:26.610586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.610559    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:28:26.873479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:26.873387    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896" event={"ID":"2d7b580d-0125-4d34-9146-c62749760b8e","Type":"ContainerStarted","Data":"533880624cbd2fce1cf210a5e231a576e62526e47739b801d9850eee2a5c7c02"}
Sep 11 19:28:27.881188 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:27.881151    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896" event={"ID":"2d7b580d-0125-4d34-9146-c62749760b8e","Type":"ContainerStarted","Data":"2ce9f4e7b9f03f686ea5e681da337c5d3c82788408fdbac66d680d937928f9a8"}
Sep 11 19:28:27.899902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:27.899854    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896" podStartSLOduration=1.789113977 podStartE2EDuration="2.899835241s" totalImagesPullingTime="1.110721264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:28:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:28:27.899612342 +0000 UTC m=+630.432668475" watchObservedRunningTime="2026-09-11 19:28:27.899835241 +0000 UTC m=+630.432891362"
Sep 11 19:28:36.322730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:36.322643    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:36.322730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:36.322727    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:36.335350 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:36.335326    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:36.940696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:36.940660    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896"
Sep 11 19:28:56.394322 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:28:56.394289    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:11.412438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.412401    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"]
Sep 11 19:29:11.416103 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.416072    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.418520 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.418497    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 11 19:29:11.425481 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.425453    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"]
Sep 11 19:29:11.443342 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443312    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqtrb\" (UniqueName: \"kubernetes.io/projected/fe704084-61ff-46bd-9c22-fc58fb027dc5-kube-api-access-rqtrb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.443342 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443344    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.443572 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443368    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.443572 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.443572 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.443572 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.443480    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe704084-61ff-46bd-9c22-fc58fb027dc5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544265 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544111    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe704084-61ff-46bd-9c22-fc58fb027dc5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544265 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544164    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqtrb\" (UniqueName: \"kubernetes.io/projected/fe704084-61ff-46bd-9c22-fc58fb027dc5-kube-api-access-rqtrb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544265 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544187    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544265 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544265 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544510 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544491    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544686 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544617    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.544755 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.544723    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.546626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.546597    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fe704084-61ff-46bd-9c22-fc58fb027dc5-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.546799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.546781    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fe704084-61ff-46bd-9c22-fc58fb027dc5-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.551827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.551802    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqtrb\" (UniqueName: \"kubernetes.io/projected/fe704084-61ff-46bd-9c22-fc58fb027dc5-kube-api-access-rqtrb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz\" (UID: \"fe704084-61ff-46bd-9c22-fc58fb027dc5\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:11.727835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:11.727752    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:12.004220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:12.004193    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"]
Sep 11 19:29:12.006435 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:29:12.006405    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe704084_61ff_46bd_9c22_fc58fb027dc5.slice/crio-328f7f1b23bcafe4b7cfcbfc5034fdd765c43447a068586aae6a69f132b82122 WatchSource:0}: Error finding container 328f7f1b23bcafe4b7cfcbfc5034fdd765c43447a068586aae6a69f132b82122: Status 404 returned error can't find the container with id 328f7f1b23bcafe4b7cfcbfc5034fdd765c43447a068586aae6a69f132b82122
Sep 11 19:29:12.008008 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:12.007989    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:29:12.094207 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:12.094173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz" event={"ID":"fe704084-61ff-46bd-9c22-fc58fb027dc5","Type":"ContainerStarted","Data":"328f7f1b23bcafe4b7cfcbfc5034fdd765c43447a068586aae6a69f132b82122"}
Sep 11 19:29:12.506778 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:12.506737    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:13.101165 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:13.101131    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz" event={"ID":"fe704084-61ff-46bd-9c22-fc58fb027dc5","Type":"ContainerStarted","Data":"ca5f1dd1f77939646497c2b800fb35e7f468034602fdfe197becf90ae83e90ae"}
Sep 11 19:29:13.119013 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:13.118964    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz" podStartSLOduration=1.952815206 podStartE2EDuration="2.118943524s" totalImagesPullingTime="166.128318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:13.117127651 +0000 UTC m=+675.650183787" watchObservedRunningTime="2026-09-11 19:29:13.118943524 +0000 UTC m=+675.651999644"
Sep 11 19:29:21.728870 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:21.728827    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:21.729367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:21.728899    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:21.740919 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:21.740896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:22.159600 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:22.159570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz"
Sep 11 19:29:31.196892 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:31.196855    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:35.005898 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:35.005859    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:41.309792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.309757    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"]
Sep 11 19:29:41.313270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.313248    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.315837 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.315815    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 11 19:29:41.321482 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.321458    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"]
Sep 11 19:29:41.416855 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.416855 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.417052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416884    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jft7j\" (UniqueName: \"kubernetes.io/projected/a98c764f-ea4e-4bb3-be3d-b3461e98b221-kube-api-access-jft7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.417052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.417052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.417052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.416981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517701 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517712    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jft7j\" (UniqueName: \"kubernetes.io/projected/a98c764f-ea4e-4bb3-be3d-b3461e98b221-kube-api-access-jft7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517766    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517791    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.517894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.517821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.518184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.518105    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.518184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.518148    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.518184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.518170    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.520122 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.520089    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a98c764f-ea4e-4bb3-be3d-b3461e98b221-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.520345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.520327    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a98c764f-ea4e-4bb3-be3d-b3461e98b221-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.525613 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.525592    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jft7j\" (UniqueName: \"kubernetes.io/projected/a98c764f-ea4e-4bb3-be3d-b3461e98b221-kube-api-access-jft7j\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-vclkd\" (UID: \"a98c764f-ea4e-4bb3-be3d-b3461e98b221\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.624772 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.624732    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:41.898644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:41.898617    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"]
Sep 11 19:29:41.900402 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:29:41.900373    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda98c764f_ea4e_4bb3_be3d_b3461e98b221.slice/crio-33faff8b1622570c7ebce78cef82b73d6c6e56371bcef62d252f3fe452ae07ab WatchSource:0}: Error finding container 33faff8b1622570c7ebce78cef82b73d6c6e56371bcef62d252f3fe452ae07ab: Status 404 returned error can't find the container with id 33faff8b1622570c7ebce78cef82b73d6c6e56371bcef62d252f3fe452ae07ab
Sep 11 19:29:42.244974 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:42.244938    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd" event={"ID":"a98c764f-ea4e-4bb3-be3d-b3461e98b221","Type":"ContainerStarted","Data":"221f52a07fab8756f2aedc88bce7a676443a4f80f03c6424abc339dca4613c29"}
Sep 11 19:29:42.245151 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:42.245018    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd" event={"ID":"a98c764f-ea4e-4bb3-be3d-b3461e98b221","Type":"ContainerStarted","Data":"33faff8b1622570c7ebce78cef82b73d6c6e56371bcef62d252f3fe452ae07ab"}
Sep 11 19:29:42.264001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:42.263942    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd" podStartSLOduration=1.066288927 podStartE2EDuration="1.263926253s" totalImagesPullingTime="197.637326ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:29:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:29:42.261695237 +0000 UTC m=+704.794751387" watchObservedRunningTime="2026-09-11 19:29:42.263926253 +0000 UTC m=+704.796982386"
Sep 11 19:29:43.112141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:43.112095    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:50.211351 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:50.211274    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:29:51.625710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:51.625674    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:51.626093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:51.625757    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:51.638147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:51.638121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:29:52.305731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:29:52.305698    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-vclkd"
Sep 11 19:30:26.998432 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:26.998395    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6cc8d7bd7d-hk578"]
Sep 11 19:30:27.001839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.001817    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.005737 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.005705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 11 19:30:27.005737 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.005709    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-nhrtd\""
Sep 11 19:30:27.010492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.010456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cc8d7bd7d-hk578"]
Sep 11 19:30:27.122506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.122468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvnjj\" (UniqueName: \"kubernetes.io/projected/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-kube-api-access-gvnjj\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.122707 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.122522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-tls-cert\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.223526 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.223489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvnjj\" (UniqueName: \"kubernetes.io/projected/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-kube-api-access-gvnjj\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.223721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.223541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-tls-cert\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.226008 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.225982    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-tls-cert\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.232069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.232044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvnjj\" (UniqueName: \"kubernetes.io/projected/1dbefefc-e2a4-46a1-b2c7-eedc93493f42-kube-api-access-gvnjj\") pod \"authorino-6cc8d7bd7d-hk578\" (UID: \"1dbefefc-e2a4-46a1-b2c7-eedc93493f42\") " pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.312182 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.312097    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6cc8d7bd7d-hk578"
Sep 11 19:30:27.581148 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:27.581123    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6cc8d7bd7d-hk578"]
Sep 11 19:30:27.582951 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:30:27.582923    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1dbefefc_e2a4_46a1_b2c7_eedc93493f42.slice/crio-8dd555e7c880e3a02ab23540ccb4e0ee96d1e465715d5273799b105aadec7c63 WatchSource:0}: Error finding container 8dd555e7c880e3a02ab23540ccb4e0ee96d1e465715d5273799b105aadec7c63: Status 404 returned error can't find the container with id 8dd555e7c880e3a02ab23540ccb4e0ee96d1e465715d5273799b105aadec7c63
Sep 11 19:30:28.474494 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:28.474452    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cc8d7bd7d-hk578" event={"ID":"1dbefefc-e2a4-46a1-b2c7-eedc93493f42","Type":"ContainerStarted","Data":"8dd555e7c880e3a02ab23540ccb4e0ee96d1e465715d5273799b105aadec7c63"}
Sep 11 19:30:33.500302 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:33.500258    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6cc8d7bd7d-hk578" event={"ID":"1dbefefc-e2a4-46a1-b2c7-eedc93493f42","Type":"ContainerStarted","Data":"b7990a41cc2782c9f6d2d52ea5709dbc9eb31cac7f350f087910318761239fc2"}
Sep 11 19:30:33.518280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:33.518227    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6cc8d7bd7d-hk578" podStartSLOduration=2.350102258 podStartE2EDuration="7.518211562s" totalImagesPullingTime="5.168109304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:33.51640752 +0000 UTC m=+756.049463644" watchObservedRunningTime="2026-09-11 19:30:33.518211562 +0000 UTC m=+756.051267683"
Sep 11 19:30:54.235237 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:54.235187    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:30:56.603914 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.603875    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7810-aafc98"]
Sep 11 19:30:56.607353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.607335    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:30:56.609895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.609872    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-v69wf\""
Sep 11 19:30:56.615847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.615824    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-aafc98"]
Sep 11 19:30:56.689423 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.689390    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h259x\" (UniqueName: \"kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x\") pod \"test-curl-7810-aafc98\" (UID: \"6110916c-2056-4ace-97e7-301da7cf5c14\") " pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:30:56.790430 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.790393    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h259x\" (UniqueName: \"kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x\") pod \"test-curl-7810-aafc98\" (UID: \"6110916c-2056-4ace-97e7-301da7cf5c14\") " pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:30:56.799026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.798994    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h259x\" (UniqueName: \"kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x\") pod \"test-curl-7810-aafc98\" (UID: \"6110916c-2056-4ace-97e7-301da7cf5c14\") " pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:30:56.917539 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:56.917454    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:30:57.189670 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:57.189557    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7810-aafc98"]
Sep 11 19:30:57.193126 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:30:57.193099    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6110916c_2056_4ace_97e7_301da7cf5c14.slice/crio-25694b654375026ed6766ca7915fa51c01a310f70d156285d953d8bcbb856c6c WatchSource:0}: Error finding container 25694b654375026ed6766ca7915fa51c01a310f70d156285d953d8bcbb856c6c: Status 404 returned error can't find the container with id 25694b654375026ed6766ca7915fa51c01a310f70d156285d953d8bcbb856c6c
Sep 11 19:30:57.626743 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:57.626705    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-aafc98" event={"ID":"6110916c-2056-4ace-97e7-301da7cf5c14","Type":"ContainerStarted","Data":"25694b654375026ed6766ca7915fa51c01a310f70d156285d953d8bcbb856c6c"}
Sep 11 19:30:59.640119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:59.640088    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7810-aafc98" event={"ID":"6110916c-2056-4ace-97e7-301da7cf5c14","Type":"ContainerStarted","Data":"b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e"}
Sep 11 19:30:59.656536 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:30:59.656484    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7810-aafc98" podStartSLOduration=1.407533935 podStartE2EDuration="3.656469314s" totalImagesPullingTime="2.248935379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:30:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:30:59.654617 +0000 UTC m=+782.187673122" watchObservedRunningTime="2026-09-11 19:30:59.656469314 +0000 UTC m=+782.189525434"
Sep 11 19:31:00.252144 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:00.252092    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7810-aafc98"]
Sep 11 19:31:00.253810 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:00.253779    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7810-aafc98"]
Sep 11 19:31:00.648235 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:00.648204    2562 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7810-aafc98" container="test-curl-7810-aafc98"
Sep 11 19:31:01.043022 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.042930    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:31:01.043585 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.043560    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" containerName="test-curl-7810-aafc98"
Sep 11 19:31:01.043585 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.043581    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" containerName="test-curl-7810-aafc98"
Sep 11 19:31:01.043713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.043701    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" containerName="test-curl-7810-aafc98"
Sep 11 19:31:01.048451 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.048426    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.051227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.051192    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-6afc47-openshift-default-dockercfg-ws6r6\""
Sep 11 19:31:01.051459 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.051439    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 19:31:01.065614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.065540    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:31:01.132697 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.132697 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132699    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.132937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4mf6\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.132937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.132937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.133088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.133088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.132984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.133088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.133022    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.133197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.133110    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4mf6\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234148    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234173    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234228    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234330    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234356    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234812 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234787    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.234932 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.234821    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.235081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.235059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.235339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.235313    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.235594 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.235569    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.236747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.236726    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.237644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.237624    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.242657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.242633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.242993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.242972    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4mf6\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6\") pod \"e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") " pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.362250 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.362212    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:01.637703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.637624    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:31:01.641929 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:01.641902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e60f7c_8df2_46dd_9fb1_b2c7daca954c.slice/crio-19de39ac133c26431e2308be1150bddf1d58bda88a6eeaf72c22bf3ac3955bfd WatchSource:0}: Error finding container 19de39ac133c26431e2308be1150bddf1d58bda88a6eeaf72c22bf3ac3955bfd: Status 404 returned error can't find the container with id 19de39ac133c26431e2308be1150bddf1d58bda88a6eeaf72c22bf3ac3955bfd
Sep 11 19:31:01.654765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.654729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerStarted","Data":"19de39ac133c26431e2308be1150bddf1d58bda88a6eeaf72c22bf3ac3955bfd"}
Sep 11 19:31:01.655199 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:01.654817    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7810-aafc98" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" containerName="test-curl-7810-aafc98" containerID="cri-o://b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e" gracePeriod=2
Sep 11 19:31:01.657240 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:01.657210    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-aafc98\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:04.324792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.324616    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:04.324792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.324719    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:04.324792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.324756    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:04.408315 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.408291    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:04.566649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.566560    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h259x\" (UniqueName: \"kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x\") pod \"6110916c-2056-4ace-97e7-301da7cf5c14\" (UID: \"6110916c-2056-4ace-97e7-301da7cf5c14\") "
Sep 11 19:31:04.568918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.568886    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x" (OuterVolumeSpecName: "kube-api-access-h259x") pod "6110916c-2056-4ace-97e7-301da7cf5c14" (UID: "6110916c-2056-4ace-97e7-301da7cf5c14"). InnerVolumeSpecName "kube-api-access-h259x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:31:04.668100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.668073    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h259x\" (UniqueName: \"kubernetes.io/projected/6110916c-2056-4ace-97e7-301da7cf5c14-kube-api-access-h259x\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:31:04.672399 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.672364    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerStarted","Data":"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"}
Sep 11 19:31:04.673734 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.673712    2562 generic.go:356] "Generic (PLEG): container finished" podID="6110916c-2056-4ace-97e7-301da7cf5c14" containerID="b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e" exitCode=137
Sep 11 19:31:04.673850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.673746    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:04.673850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.673750    2562 scope.go:117] "RemoveContainer" containerID="b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e"
Sep 11 19:31:04.682674 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.682654    2562 scope.go:117] "RemoveContainer" containerID="b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e"
Sep 11 19:31:04.682936 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:04.682917    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e\": container with ID starting with b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e not found: ID does not exist" containerID="b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e"
Sep 11 19:31:04.683001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.682947    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e"} err="failed to get container status \"b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e\": rpc error: code = NotFound desc = could not find container \"b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e\": container with ID starting with b0cc9014d0ac0b6e59bbe0d6d20db6179a41f3676545bf29df7531cda4989c8e not found: ID does not exist"
Sep 11 19:31:04.702324 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:04.702280    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podStartSLOduration=1.022420774 podStartE2EDuration="3.702263583s" totalImagesPullingTime="2.679842809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:04.701356615 +0000 UTC m=+787.234412774" watchObservedRunningTime="2026-09-11 19:31:04.702263583 +0000 UTC m=+787.235319763"
Sep 11 19:31:04.703588 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:04.703540    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-aafc98\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:05.363079 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.363046    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:05.368080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.368056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:05.370243 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:05.370218    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-aafc98\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:05.680579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.680462    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:05.681498 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.681480    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:05.683688 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:05.683663    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-aafc98\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:05.735307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.735268    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:05.738902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.738878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.741596 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.741522    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:31:05.741745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.741658    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 19:31:05.741745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.741691    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-cac5b9bc-serving-cert\""
Sep 11 19:31:05.742133 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.742106    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5hbtr\""
Sep 11 19:31:05.742242 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.742226    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 19:31:05.749880 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.749685    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:05.771131 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:05.771094    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7810-aafc98\" is forbidden: User \"system:node:ip-10-0-141-0.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-0.ec2.internal' and this object" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" pod="opendatahub/test-curl-7810-aafc98"
Sep 11 19:31:05.878424 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.878384    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.878644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.878428    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5rmc\" (UniqueName: \"kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.878644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.878471    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.878644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.878501    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.979857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.979770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.979857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.979803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5rmc\" (UniqueName: \"kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.979857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.979824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.979857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.979854    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.980184 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:05.979998    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-serving-cert: secret "maas-api-e2e-ait-cac5b9bc-serving-cert" not found
Sep 11 19:31:05.980184 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:05.980057    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls podName:a72a36d3-af03-4b8f-b701-fc8865eb6b55 nodeName:}" failed. No retries permitted until 2026-09-11 19:31:06.48003704 +0000 UTC m=+789.013093149 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls") pod "maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" (UID: "a72a36d3-af03-4b8f-b701-fc8865eb6b55") : secret "maas-api-e2e-ait-cac5b9bc-serving-cert" not found
Sep 11 19:31:05.980591 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.980522    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.981268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.981237    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6110916c-2056-4ace-97e7-301da7cf5c14" path="/var/lib/kubelet/pods/6110916c-2056-4ace-97e7-301da7cf5c14/volumes"
Sep 11 19:31:05.982639 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.982620    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:05.991733 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:05.991709    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5rmc\" (UniqueName: \"kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:06.034143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:06.034093    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:31:06.484381 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:06.484346    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:06.486841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:06.486815    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") pod \"maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:06.654968 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:06.654933    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:06.941158 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:06.941134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:06.942740 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:06.942714    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda72a36d3_af03_4b8f_b701_fc8865eb6b55.slice/crio-f1ceb2d535d3e9c53879bc0c883c775be2e6dee7d06a499af1153aa5dc6206ef WatchSource:0}: Error finding container f1ceb2d535d3e9c53879bc0c883c775be2e6dee7d06a499af1153aa5dc6206ef: Status 404 returned error can't find the container with id f1ceb2d535d3e9c53879bc0c883c775be2e6dee7d06a499af1153aa5dc6206ef
Sep 11 19:31:07.694921 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:07.694879    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" event={"ID":"a72a36d3-af03-4b8f-b701-fc8865eb6b55","Type":"ContainerStarted","Data":"f1ceb2d535d3e9c53879bc0c883c775be2e6dee7d06a499af1153aa5dc6206ef"}
Sep 11 19:31:09.708533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:09.708445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" event={"ID":"a72a36d3-af03-4b8f-b701-fc8865eb6b55","Type":"ContainerStarted","Data":"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"}
Sep 11 19:31:09.708533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:09.708509    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:09.732823 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:09.732770    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" podStartSLOduration=2.337845571 podStartE2EDuration="4.732754014s" totalImagesPullingTime="2.394908443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:09.731497202 +0000 UTC m=+792.264553353" watchObservedRunningTime="2026-09-11 19:31:09.732754014 +0000 UTC m=+792.265810135"
Sep 11 19:31:14.642274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.640669    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:31:14.645145 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.645116    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.648347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.648319    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-515a4f-openshift-default-dockercfg-wljdb\""
Sep 11 19:31:14.662303 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.662239    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:31:14.762686 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762861    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762920    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.762996 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7sdl\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.763092 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.762995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.763092 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.763009    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864152    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864221    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864279    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7sdl\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864331    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864353    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864700 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864700 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864488    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864805 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864711    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.864863 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.864799    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.865104 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.865081    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.865241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.865222    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.865362 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.865343    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.866768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.866746    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.866908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.866890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.875624 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.875594    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7sdl\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.881845 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.881824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token\") pod \"e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") " pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:14.961650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:14.961571    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:15.244575 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.244532    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:31:15.247589 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:15.246888    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod663081de_a940_4d36_bd02_effda39fd370.slice/crio-9e5f875ffdbe8b86af97b57f7a9734a5751fbcd07ea67a4b6c9ba35359af038b WatchSource:0}: Error finding container 9e5f875ffdbe8b86af97b57f7a9734a5751fbcd07ea67a4b6c9ba35359af038b: Status 404 returned error can't find the container with id 9e5f875ffdbe8b86af97b57f7a9734a5751fbcd07ea67a4b6c9ba35359af038b
Sep 11 19:31:15.251048 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.251012    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:15.251166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.251099    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:15.251166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.251148    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:15.718710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.718673    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:15.741294 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.741243    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerStarted","Data":"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"}
Sep 11 19:31:15.741470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.741311    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerStarted","Data":"9e5f875ffdbe8b86af97b57f7a9734a5751fbcd07ea67a4b6c9ba35359af038b"}
Sep 11 19:31:15.764344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.764048    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podStartSLOduration=1.764024394 podStartE2EDuration="1.764024394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:15.763415106 +0000 UTC m=+798.296471254" watchObservedRunningTime="2026-09-11 19:31:15.764024394 +0000 UTC m=+798.297080516"
Sep 11 19:31:15.962194 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:15.962163    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:16.976254 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:16.976221    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:17.757503 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:17.757476    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:17.765071 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:17.765043    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:19.066569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.066008    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:31:19.076568 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.075987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.078669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.078644    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-515a4f-serving-cert\""
Sep 11 19:31:19.089496 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.089468    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:31:19.207448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.207412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.207448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.207461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gsws5\" (UniqueName: \"kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.207728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.207482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.207728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.207509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.308185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.308144    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.308375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.308211    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gsws5\" (UniqueName: \"kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.308375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.308235    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.308375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.308254    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.308919 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:19.308891    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-serving-cert: secret "maas-api-e2e-inf-b-515a4f-serving-cert" not found
Sep 11 19:31:19.309031 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:19.308986    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls podName:06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705 nodeName:}" failed. No retries permitted until 2026-09-11 19:31:19.808964875 +0000 UTC m=+802.342020994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls") pod "maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" (UID: "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705") : secret "maas-api-e2e-inf-b-515a4f-serving-cert" not found
Sep 11 19:31:19.309231 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.309182    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.311003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.310980    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.320069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.320022    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gsws5\" (UniqueName: \"kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.813138 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.813105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.815401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.815371    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") pod \"maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:19.993600 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:19.993540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:20.292728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:20.292691    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:31:20.294706 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:20.294663    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06f13bd6_dfb6_4ac9_ab2d_3aaf7d4fc705.slice/crio-f9f49a9745d30fa7787e0b4d66a3505d35ed9dc2d8fad10183054fd8297aeaf0 WatchSource:0}: Error finding container f9f49a9745d30fa7787e0b4d66a3505d35ed9dc2d8fad10183054fd8297aeaf0: Status 404 returned error can't find the container with id f9f49a9745d30fa7787e0b4d66a3505d35ed9dc2d8fad10183054fd8297aeaf0
Sep 11 19:31:20.786055 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:20.786013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" event={"ID":"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705","Type":"ContainerStarted","Data":"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"}
Sep 11 19:31:20.786252 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:20.786079    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:20.786252 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:20.786096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" event={"ID":"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705","Type":"ContainerStarted","Data":"f9f49a9745d30fa7787e0b4d66a3505d35ed9dc2d8fad10183054fd8297aeaf0"}
Sep 11 19:31:24.810198 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.810114    2562 generic.go:356] "Generic (PLEG): container finished" podID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerID="2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa" exitCode=0
Sep 11 19:31:24.810608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.810192    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerDied","Data":"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"}
Sep 11 19:31:24.810661 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.810647    2562 scope.go:117] "RemoveContainer" containerID="2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"
Sep 11 19:31:24.812712 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.812682    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:24.812786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.812753    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:24.812822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.812788    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:24.837377 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:24.837337    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" podStartSLOduration=5.442042026 podStartE2EDuration="5.837321271s" totalImagesPullingTime="395.279245ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:20.802617969 +0000 UTC m=+803.335674108" watchObservedRunningTime="2026-09-11 19:31:24.837321271 +0000 UTC m=+807.370377438"
Sep 11 19:31:25.817910 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:25.817877    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerStarted","Data":"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"}
Sep 11 19:31:26.365025 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:26.364982    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:26.365232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:26.365116    2562 patch_prober.go:28] interesting pod/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 19:31:26.365232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:26.365165    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 19:31:26.796799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:26.796729    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:31:27.035412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:27.035348    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:31:27.363034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:27.362984    2562 patch_prober.go:28] interesting pod/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 19:31:27.363297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:27.363057    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 19:31:28.363180 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:28.363143    2562 patch_prober.go:28] interesting pod/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 19:31:28.363754 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:28.363720    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 19:31:29.363626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:29.363578    2562 patch_prober.go:28] interesting pod/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 19:31:29.364125 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:29.363650    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 19:31:30.362662 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:30.362624    2562 patch_prober.go:28] interesting pod/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused" start-of-body=
Sep 11 19:31:30.362928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:30.362901    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.47:15021/healthz/ready\": dial tcp 10.132.0.47:15021: connect: connection refused"
Sep 11 19:31:31.422874 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:31.422839    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:31.423340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:31.423160    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:31.424304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:31.424280    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:31:33.768974 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:33.768938    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:33.770488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:33.770440    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" podUID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" containerName="maas-api" containerID="cri-o://b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026" gracePeriod=30
Sep 11 19:31:34.104904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.104881    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:34.176962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.176903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs\") pod \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") "
Sep 11 19:31:34.177243 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.177226    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5rmc\" (UniqueName: \"kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc\") pod \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") "
Sep 11 19:31:34.177403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.177391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") pod \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") "
Sep 11 19:31:34.177505 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.177494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca\") pod \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\" (UID: \"a72a36d3-af03-4b8f-b701-fc8865eb6b55\") "
Sep 11 19:31:34.178249 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.178226    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a72a36d3-af03-4b8f-b701-fc8865eb6b55" (UID: "a72a36d3-af03-4b8f-b701-fc8865eb6b55"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:31:34.181112 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.181085    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc" (OuterVolumeSpecName: "kube-api-access-g5rmc") pod "a72a36d3-af03-4b8f-b701-fc8865eb6b55" (UID: "a72a36d3-af03-4b8f-b701-fc8865eb6b55"). InnerVolumeSpecName "kube-api-access-g5rmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:31:34.181789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.181770    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a72a36d3-af03-4b8f-b701-fc8865eb6b55" (UID: "a72a36d3-af03-4b8f-b701-fc8865eb6b55"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:31:34.182049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.182032    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a72a36d3-af03-4b8f-b701-fc8865eb6b55" (UID: "a72a36d3-af03-4b8f-b701-fc8865eb6b55"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:31:34.279610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.279487    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.279610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.279526    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a72a36d3-af03-4b8f-b701-fc8865eb6b55-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.279610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.279540    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a72a36d3-af03-4b8f-b701-fc8865eb6b55-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.279610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.279582    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5rmc\" (UniqueName: \"kubernetes.io/projected/a72a36d3-af03-4b8f-b701-fc8865eb6b55-kube-api-access-g5rmc\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:31:34.884483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.884448    2562 generic.go:356] "Generic (PLEG): container finished" podID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" containerID="b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026" exitCode=0
Sep 11 19:31:34.884938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.884564    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"
Sep 11 19:31:34.884938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.884496    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" event={"ID":"a72a36d3-af03-4b8f-b701-fc8865eb6b55","Type":"ContainerDied","Data":"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"}
Sep 11 19:31:34.884938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.884641    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84" event={"ID":"a72a36d3-af03-4b8f-b701-fc8865eb6b55","Type":"ContainerDied","Data":"f1ceb2d535d3e9c53879bc0c883c775be2e6dee7d06a499af1153aa5dc6206ef"}
Sep 11 19:31:34.884938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.884664    2562 scope.go:117] "RemoveContainer" containerID="b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"
Sep 11 19:31:34.894669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.894652    2562 scope.go:117] "RemoveContainer" containerID="b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"
Sep 11 19:31:34.894931 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:31:34.894912    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026\": container with ID starting with b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026 not found: ID does not exist" containerID="b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"
Sep 11 19:31:34.895002 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.894940    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026"} err="failed to get container status \"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026\": rpc error: code = NotFound desc = could not find container \"b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026\": container with ID starting with b57833c0c0388f0d5d72e723293192d0281f4d95d677de25609cdbf91405b026 not found: ID does not exist"
Sep 11 19:31:34.910061 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.910025    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:34.914114 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:34.914089    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-cac5b9bc-5559b4c9f4-txs84"]
Sep 11 19:31:35.354569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.354191    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:31:35.354913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.354888    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" containerName="maas-api"
Sep 11 19:31:35.355066 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.355052    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" containerName="maas-api"
Sep 11 19:31:35.355305 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.355288    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" containerName="maas-api"
Sep 11 19:31:35.371087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.371056    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.372274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.370953    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:31:35.374985 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.374967    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-da3756c4-gw-openshift-default-dockercfg-xxjgr\""
Sep 11 19:31:35.491841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491811    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491873    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491937    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvsx\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.491981    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.492007    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.492030    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.492402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.492070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592772    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592797    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592825    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592847    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvsx\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.592938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593242 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592939    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593242 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.592972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.593320    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.593324    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593832 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.593806    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.593981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.593947    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.594506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.594477    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.595605 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.595575    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.595692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.595676    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.602432 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.602408    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.607018 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.606988    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvsx\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx\") pod \"e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") " pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.685951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.685915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:35.964407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.964376    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:31:35.966659 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:35.966627    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc706c6_0d29_43d6_ba39_9179202bf2f5.slice/crio-a1c2ec4a8fa0587bc0087f30664a4eb1341fbcfbe4e1c0ead0b7f3773c89321f WatchSource:0}: Error finding container a1c2ec4a8fa0587bc0087f30664a4eb1341fbcfbe4e1c0ead0b7f3773c89321f: Status 404 returned error can't find the container with id a1c2ec4a8fa0587bc0087f30664a4eb1341fbcfbe4e1c0ead0b7f3773c89321f
Sep 11 19:31:35.969159 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.969127    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:35.969268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.969194    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:35.969268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.969224    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:35.987617 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:35.987581    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a72a36d3-af03-4b8f-b701-fc8865eb6b55" path="/var/lib/kubelet/pods/a72a36d3-af03-4b8f-b701-fc8865eb6b55/volumes"
Sep 11 19:31:36.899511 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:36.899467    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerStarted","Data":"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"}
Sep 11 19:31:36.899706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:36.899540    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerStarted","Data":"a1c2ec4a8fa0587bc0087f30664a4eb1341fbcfbe4e1c0ead0b7f3773c89321f"}
Sep 11 19:31:36.921490 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:36.921428    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podStartSLOduration=1.921411124 podStartE2EDuration="1.921411124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:36.918594141 +0000 UTC m=+819.451650277" watchObservedRunningTime="2026-09-11 19:31:36.921411124 +0000 UTC m=+819.454467317"
Sep 11 19:31:37.686533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:37.686487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:37.692574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:37.692528    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:37.906342 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:37.906314    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:37.907447 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:37.907422    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:31:38.913334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.913301    2562 generic.go:356] "Generic (PLEG): container finished" podID="663081de-a940-4d36-bd02-effda39fd370" containerID="eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4" exitCode=0
Sep 11 19:31:38.913879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.913380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerDied","Data":"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"}
Sep 11 19:31:38.913879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.913855    2562 scope.go:117] "RemoveContainer" containerID="eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"
Sep 11 19:31:38.914951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.914924    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:38.915003 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.914994    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:38.915041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:38.915028    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:39.924977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:39.924942    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerStarted","Data":"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"}
Sep 11 19:31:39.964569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:39.962951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:39.964569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:39.963086    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:39.964569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:39.963144    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:40.962370 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:40.962332    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:40.962980 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:40.962945    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:41.408805 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.408768    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:31:41.412657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.412634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.416468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.416448    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-da3756c4-serving-cert\""
Sep 11 19:31:41.425815 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.425614    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:31:41.561571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.561101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.561571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.561199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xxvh\" (UniqueName: \"kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.561571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.561272    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.561571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.561325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.663603 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.662760    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.663603 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.662861    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xxvh\" (UniqueName: \"kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.663603 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.662934    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.663603 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.662988    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.665064 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.665038    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.666888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.666336    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.666888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.666829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.674235 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.674185    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xxvh\" (UniqueName: \"kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh\") pod \"maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.726947 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.726912    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:41.966629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.965939    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:41.966629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:41.966012    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:42.036426 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.036388    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:31:42.037273 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:31:42.037244    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56fbc939_645b_4d73_acac_2eb73b48d304.slice/crio-6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff WatchSource:0}: Error finding container 6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff: Status 404 returned error can't find the container with id 6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff
Sep 11 19:31:42.943607 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.943561    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" event={"ID":"56fbc939-645b-4d73-acac-2eb73b48d304","Type":"ContainerStarted","Data":"afa0b3401bbfbd80619e452c37acc539eb836f38575b9db7bed281b40932d871"}
Sep 11 19:31:42.943787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.943629    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" event={"ID":"56fbc939-645b-4d73-acac-2eb73b48d304","Type":"ContainerStarted","Data":"6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff"}
Sep 11 19:31:42.943787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.943656    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:42.962089 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.962047    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:42.962263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.962154    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:42.963484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:42.963424    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" podStartSLOduration=1.595959763 podStartE2EDuration="1.963403358s" totalImagesPullingTime="367.443595ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:31:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:31:42.96137534 +0000 UTC m=+825.494431486" watchObservedRunningTime="2026-09-11 19:31:42.963403358 +0000 UTC m=+825.496459481"
Sep 11 19:31:43.962559 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:43.962499    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:43.963045 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:43.962583    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:44.962962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:44.962914    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body=
Sep 11 19:31:44.963481 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:44.962984    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused"
Sep 11 19:31:45.966586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:45.966526    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:45.967071 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:45.966814    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:45.967386 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:45.967369    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:31:48.411195 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:48.411153    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:31:48.956786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:48.956754    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:31:59.047845 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.047769    2562 generic.go:356] "Generic (PLEG): container finished" podID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerID="76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c" exitCode=0
Sep 11 19:31:59.048248 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.047841    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerDied","Data":"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"}
Sep 11 19:31:59.048248 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.048202    2562 scope.go:117] "RemoveContainer" containerID="76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"
Sep 11 19:31:59.049584 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.049526    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:59.049666 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.049625    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:31:59.049666 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:31:59.049661    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:00.060391 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:00.060346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerStarted","Data":"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"}
Sep 11 19:32:00.686625 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:00.686587    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:00.686883 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:00.686858    2562 patch_prober.go:28] interesting pod/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:32:00.686977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:00.686919    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 11 19:32:01.687321 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:01.687285    2562 patch_prober.go:28] interesting pod/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:32:01.687714 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:01.687339    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 11 19:32:02.686439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:02.686402    2562 patch_prober.go:28] interesting pod/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:32:02.686643 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:02.686482    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 11 19:32:03.686933 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:03.686892    2562 patch_prober.go:28] interesting pod/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:32:03.687427 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:03.686962    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 11 19:32:04.687446 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:04.687407    2562 patch_prober.go:28] interesting pod/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Sep 11 19:32:04.687856 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:04.687466    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Sep 11 19:32:05.690947 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:05.690910    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:05.691323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:05.691287    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:05.691981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:05.691961    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:09.875167 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:09.875132    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:32:09.875649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:09.875359    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" podUID="56fbc939-645b-4d73-acac-2eb73b48d304" containerName="maas-api" containerID="cri-o://afa0b3401bbfbd80619e452c37acc539eb836f38575b9db7bed281b40932d871" gracePeriod=30
Sep 11 19:32:10.124829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.124792    2562 generic.go:356] "Generic (PLEG): container finished" podID="56fbc939-645b-4d73-acac-2eb73b48d304" containerID="afa0b3401bbfbd80619e452c37acc539eb836f38575b9db7bed281b40932d871" exitCode=0
Sep 11 19:32:10.124994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.124878    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" event={"ID":"56fbc939-645b-4d73-acac-2eb73b48d304","Type":"ContainerDied","Data":"afa0b3401bbfbd80619e452c37acc539eb836f38575b9db7bed281b40932d871"}
Sep 11 19:32:10.124994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.124959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d" event={"ID":"56fbc939-645b-4d73-acac-2eb73b48d304","Type":"ContainerDied","Data":"6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff"}
Sep 11 19:32:10.125093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.124998    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6726113aed1ce92cb421ac9c9e439be7159cddef35c4c22bdfe79d3f61a450ff"
Sep 11 19:32:10.139386 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.139324    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:32:10.258957 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.258920    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs\") pod \"56fbc939-645b-4d73-acac-2eb73b48d304\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") "
Sep 11 19:32:10.259136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.259004    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xxvh\" (UniqueName: \"kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh\") pod \"56fbc939-645b-4d73-acac-2eb73b48d304\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") "
Sep 11 19:32:10.259136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.259059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls\") pod \"56fbc939-645b-4d73-acac-2eb73b48d304\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") "
Sep 11 19:32:10.259136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.259105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca\") pod \"56fbc939-645b-4d73-acac-2eb73b48d304\" (UID: \"56fbc939-645b-4d73-acac-2eb73b48d304\") "
Sep 11 19:32:10.259562 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.259502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56fbc939-645b-4d73-acac-2eb73b48d304" (UID: "56fbc939-645b-4d73-acac-2eb73b48d304"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:10.261171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.261143    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh" (OuterVolumeSpecName: "kube-api-access-7xxvh") pod "56fbc939-645b-4d73-acac-2eb73b48d304" (UID: "56fbc939-645b-4d73-acac-2eb73b48d304"). InnerVolumeSpecName "kube-api-access-7xxvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:10.261437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.261417    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "56fbc939-645b-4d73-acac-2eb73b48d304" (UID: "56fbc939-645b-4d73-acac-2eb73b48d304"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:10.261504 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.261438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56fbc939-645b-4d73-acac-2eb73b48d304" (UID: "56fbc939-645b-4d73-acac-2eb73b48d304"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:10.360370 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.360333    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56fbc939-645b-4d73-acac-2eb73b48d304-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.360370 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.360370    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.360644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.360384    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xxvh\" (UniqueName: \"kubernetes.io/projected/56fbc939-645b-4d73-acac-2eb73b48d304-kube-api-access-7xxvh\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.360644 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.360397    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56fbc939-645b-4d73-acac-2eb73b48d304-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:10.432635 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.432532    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:32:10.432792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:10.432752    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy" containerID="cri-o://fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef" gracePeriod=30
Sep 11 19:32:11.131843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.131809    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"
Sep 11 19:32:11.164909 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.164876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:32:11.175305 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.175264    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-da3756c4-846d9788d6-w7d6d"]
Sep 11 19:32:11.177500 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.177474    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:11.178037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.178021    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56fbc939-645b-4d73-acac-2eb73b48d304" containerName="maas-api"
Sep 11 19:32:11.178094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.178040    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="56fbc939-645b-4d73-acac-2eb73b48d304" containerName="maas-api"
Sep 11 19:32:11.178131 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.178114    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="56fbc939-645b-4d73-acac-2eb73b48d304" containerName="maas-api"
Sep 11 19:32:11.181338 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.181319    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.184929 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.184905    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-846167e5-openshift-default-dockercfg-mx2lm\""
Sep 11 19:32:11.197312 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.197286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:11.270090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.269996    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270043    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270293    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270467 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270467 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270468    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sn8k\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270541    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.270708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.270603    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.371941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.371906    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.371941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.371946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372160 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372160 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372104    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372253 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372253 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372262    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372318    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372319    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sn8k\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372483 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372390    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372495    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372689    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.372888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.372869    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.374436 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.374411    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.374596 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.374485    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.380721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.380696    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sn8k\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.380819 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.380728    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token\") pod \"e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") " pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.492567 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.492472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:11.771422 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.771392    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:11.772242 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:32:11.772208    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d1fb05_0f00_43fe_b298_a253f22af550.slice/crio-e66b123da9f300b91c17a87eefa853d493d5ce78a051a147add05515b3a4225f WatchSource:0}: Error finding container e66b123da9f300b91c17a87eefa853d493d5ce78a051a147add05515b3a4225f: Status 404 returned error can't find the container with id e66b123da9f300b91c17a87eefa853d493d5ce78a051a147add05515b3a4225f
Sep 11 19:32:11.774821 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.774774    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:11.774938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.774872    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:11.774938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.774919    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:11.980300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:11.980262    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56fbc939-645b-4d73-acac-2eb73b48d304" path="/var/lib/kubelet/pods/56fbc939-645b-4d73-acac-2eb73b48d304/volumes"
Sep 11 19:32:12.139300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:12.139259    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerStarted","Data":"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"}
Sep 11 19:32:12.139699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:12.139323    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerStarted","Data":"e66b123da9f300b91c17a87eefa853d493d5ce78a051a147add05515b3a4225f"}
Sep 11 19:32:12.160922 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:12.160869    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podStartSLOduration=1.160851299 podStartE2EDuration="1.160851299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:12.159076605 +0000 UTC m=+854.692132727" watchObservedRunningTime="2026-09-11 19:32:12.160851299 +0000 UTC m=+854.693907419"
Sep 11 19:32:12.492884 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:12.492798    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:12.498342 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:12.498316    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:13.144080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:13.144048    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:13.145191 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:13.145174    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:15.696275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.696216    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:15.819026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.818997    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhvsx\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819044    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819075    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819116    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819164    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819209    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819260    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819326    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:15.819412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819355    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy\") pod \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\" (UID: \"1bc706c6-0d29-43d6-ba39-9179202bf2f5\") "
Sep 11 19:32:15.819705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:15.819705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819518    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:15.819705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819578    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:15.819858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819773    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.819858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819798    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.819858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819812    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.819858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819824    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.819858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.819844    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:15.821392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.821372    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:32:15.821506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.821468    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:15.821815 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.821796    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:15.821866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.821824    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx" (OuterVolumeSpecName: "kube-api-access-rhvsx") pod "1bc706c6-0d29-43d6-ba39-9179202bf2f5" (UID: "1bc706c6-0d29-43d6-ba39-9179202bf2f5"). InnerVolumeSpecName "kube-api-access-rhvsx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:15.920799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.920768    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.920799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.920797    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.920799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.920806    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.921024 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.920814    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bc706c6-0d29-43d6-ba39-9179202bf2f5-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:15.921024 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:15.920822    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhvsx\" (UniqueName: \"kubernetes.io/projected/1bc706c6-0d29-43d6-ba39-9179202bf2f5-kube-api-access-rhvsx\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:16.012761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.012727    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:32:16.120192 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120153    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:16.120790 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120766    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.120790 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120788    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.121014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120846    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.121014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120856    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.121014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120965    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.121014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.120980    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerName="istio-proxy"
Sep 11 19:32:16.126091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.126068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.128363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.128344    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-846167e5-serving-cert\""
Sep 11 19:32:16.134419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.134395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:16.167666 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.167603    2562 generic.go:356] "Generic (PLEG): container finished" podID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" containerID="fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef" exitCode=0
Sep 11 19:32:16.167835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.167672    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"
Sep 11 19:32:16.167835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.167677    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerDied","Data":"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"}
Sep 11 19:32:16.167835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.167737    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4" event={"ID":"1bc706c6-0d29-43d6-ba39-9179202bf2f5","Type":"ContainerDied","Data":"a1c2ec4a8fa0587bc0087f30664a4eb1341fbcfbe4e1c0ead0b7f3773c89321f"}
Sep 11 19:32:16.167835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.167762    2562 scope.go:117] "RemoveContainer" containerID="fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"
Sep 11 19:32:16.177819 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.177803    2562 scope.go:117] "RemoveContainer" containerID="76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"
Sep 11 19:32:16.184561 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.184526    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:32:16.186220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.186197    2562 scope.go:117] "RemoveContainer" containerID="fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"
Sep 11 19:32:16.186598 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:16.186534    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef\": container with ID starting with fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef not found: ID does not exist" containerID="fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"
Sep 11 19:32:16.186681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.186607    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef"} err="failed to get container status \"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef\": rpc error: code = NotFound desc = could not find container \"fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef\": container with ID starting with fbf59d2d001ae07af3f927e45851011a14bd7d4d4d9e429835a51cd8335436ef not found: ID does not exist"
Sep 11 19:32:16.186681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.186624    2562 scope.go:117] "RemoveContainer" containerID="76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"
Sep 11 19:32:16.186947 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:16.186918    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c\": container with ID starting with 76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c not found: ID does not exist" containerID="76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"
Sep 11 19:32:16.187019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.186956    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c"} err="failed to get container status \"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c\": rpc error: code = NotFound desc = could not find container \"76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c\": container with ID starting with 76d934738e916f758facdd5c041ec7210c9c84d19e0eed72c870b4fd69e79e0c not found: ID does not exist"
Sep 11 19:32:16.189984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.189964    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-da3756c4-gw-openshift-default-5f49fc99c6-kp4q4"]
Sep 11 19:32:16.224614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.224587    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.224753 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.224652    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.224810 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.224795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpzq\" (UniqueName: \"kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.224860 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.224826    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.325928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.325890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpzq\" (UniqueName: \"kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.326135 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.325949    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.326135 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.326011    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.326135 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.326048    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.326314 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:16.326188    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-serving-cert: secret "maas-api-e2e-ait-846167e5-serving-cert" not found
Sep 11 19:32:16.326314 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:16.326264    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls podName:8caccdca-a84c-4f26-9b60-a89112b444b0 nodeName:}" failed. No retries permitted until 2026-09-11 19:32:16.826241505 +0000 UTC m=+859.359297606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls") pod "maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" (UID: "8caccdca-a84c-4f26-9b60-a89112b444b0") : secret "maas-api-e2e-ait-846167e5-serving-cert" not found
Sep 11 19:32:16.326852 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.326829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.328857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.328837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.334602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.334583    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpzq\" (UniqueName: \"kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.830926 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.830896    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:16.833188 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:16.833168    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") pod \"maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:17.040873 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:17.040840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:17.322478 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:17.322439    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:17.980401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:17.980326    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bc706c6-0d29-43d6-ba39-9179202bf2f5" path="/var/lib/kubelet/pods/1bc706c6-0d29-43d6-ba39-9179202bf2f5/volumes"
Sep 11 19:32:18.185501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:18.185465    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" event={"ID":"8caccdca-a84c-4f26-9b60-a89112b444b0","Type":"ContainerStarted","Data":"6a6d22b3b777749a11dd70ed03841ee8955b1c23c79c1053e712369f325ec33c"}
Sep 11 19:32:18.185699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:18.185525    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" event={"ID":"8caccdca-a84c-4f26-9b60-a89112b444b0","Type":"ContainerStarted","Data":"431d40f28e7ce573e96eb692f98771a7b0c703d413e45020a664fe82c9292e8f"}
Sep 11 19:32:18.185699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:18.185567    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:18.206599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:18.206532    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" podStartSLOduration=1.810353443 podStartE2EDuration="2.206515678s" totalImagesPullingTime="396.162235ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:18.204273942 +0000 UTC m=+860.737330073" watchObservedRunningTime="2026-09-11 19:32:18.206515678 +0000 UTC m=+860.739571799"
Sep 11 19:32:24.196167 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:24.196139    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:32.905173 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:32.905134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:32:35.286409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.286376    2562 generic.go:356] "Generic (PLEG): container finished" podID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerID="675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1" exitCode=0
Sep 11 19:32:35.286865 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.286450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerDied","Data":"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"}
Sep 11 19:32:35.286964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.286948    2562 scope.go:117] "RemoveContainer" containerID="675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"
Sep 11 19:32:35.288185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.288158    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:35.288291 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.288228    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:35.288291 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:35.288259    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:36.293489 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:36.293401    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerStarted","Data":"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"}
Sep 11 19:32:36.493699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:36.493660    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:36.493904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:36.493876    2562 patch_prober.go:28] interesting pod/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 19:32:36.494034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:36.493938    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 19:32:37.492892 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:37.492855    2562 patch_prober.go:28] interesting pod/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 19:32:37.493262 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:37.492908    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 19:32:38.492864 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:38.492825    2562 patch_prober.go:28] interesting pod/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 19:32:38.493045 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:38.492881    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 19:32:39.492904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:39.492863    2562 patch_prober.go:28] interesting pod/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 19:32:39.493083 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:39.492920    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 19:32:40.493787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:40.493751    2562 patch_prober.go:28] interesting pod/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body=
Sep 11 19:32:40.494165 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:40.493805    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused"
Sep 11 19:32:41.497467 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:41.497434    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:41.497846 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:41.497779    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:41.498569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:41.498532    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:45.221137 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.221105    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:45.221513 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.221317    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" podUID="8caccdca-a84c-4f26-9b60-a89112b444b0" containerName="maas-api" containerID="cri-o://6a6d22b3b777749a11dd70ed03841ee8955b1c23c79c1053e712369f325ec33c" gracePeriod=30
Sep 11 19:32:45.343472 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.343445    2562 generic.go:356] "Generic (PLEG): container finished" podID="8caccdca-a84c-4f26-9b60-a89112b444b0" containerID="6a6d22b3b777749a11dd70ed03841ee8955b1c23c79c1053e712369f325ec33c" exitCode=0
Sep 11 19:32:45.343619 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.343517    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" event={"ID":"8caccdca-a84c-4f26-9b60-a89112b444b0","Type":"ContainerDied","Data":"6a6d22b3b777749a11dd70ed03841ee8955b1c23c79c1053e712369f325ec33c"}
Sep 11 19:32:45.485353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.485294    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:45.631796 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.631750    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdpzq\" (UniqueName: \"kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq\") pod \"8caccdca-a84c-4f26-9b60-a89112b444b0\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") "
Sep 11 19:32:45.631963 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.631890    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs\") pod \"8caccdca-a84c-4f26-9b60-a89112b444b0\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") "
Sep 11 19:32:45.631963 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.631941    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca\") pod \"8caccdca-a84c-4f26-9b60-a89112b444b0\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") "
Sep 11 19:32:45.632074 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.632025    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") pod \"8caccdca-a84c-4f26-9b60-a89112b444b0\" (UID: \"8caccdca-a84c-4f26-9b60-a89112b444b0\") "
Sep 11 19:32:45.632366 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.632335    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8caccdca-a84c-4f26-9b60-a89112b444b0" (UID: "8caccdca-a84c-4f26-9b60-a89112b444b0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:45.634051 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.634016    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq" (OuterVolumeSpecName: "kube-api-access-hdpzq") pod "8caccdca-a84c-4f26-9b60-a89112b444b0" (UID: "8caccdca-a84c-4f26-9b60-a89112b444b0"). InnerVolumeSpecName "kube-api-access-hdpzq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:45.634152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.634061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8caccdca-a84c-4f26-9b60-a89112b444b0" (UID: "8caccdca-a84c-4f26-9b60-a89112b444b0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:45.634152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.634107    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8caccdca-a84c-4f26-9b60-a89112b444b0" (UID: "8caccdca-a84c-4f26-9b60-a89112b444b0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:32:45.733578 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.733526    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.733578 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.733572    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdpzq\" (UniqueName: \"kubernetes.io/projected/8caccdca-a84c-4f26-9b60-a89112b444b0-kube-api-access-hdpzq\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.733776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.733586    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8caccdca-a84c-4f26-9b60-a89112b444b0-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:45.733776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:45.733599    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8caccdca-a84c-4f26-9b60-a89112b444b0-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:46.352335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.352304    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"
Sep 11 19:32:46.352335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.352313    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7" event={"ID":"8caccdca-a84c-4f26-9b60-a89112b444b0","Type":"ContainerDied","Data":"431d40f28e7ce573e96eb692f98771a7b0c703d413e45020a664fe82c9292e8f"}
Sep 11 19:32:46.352897 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.352388    2562 scope.go:117] "RemoveContainer" containerID="6a6d22b3b777749a11dd70ed03841ee8955b1c23c79c1053e712369f325ec33c"
Sep 11 19:32:46.372634 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.372608    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:46.379792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.379768    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-846167e5-64d57b7bd-ddcc7"]
Sep 11 19:32:46.597599 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.597534    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:46.597784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:46.597759    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy" containerID="cri-o://f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f" gracePeriod=30
Sep 11 19:32:47.362564 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.362511    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:32:47.363867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.363843    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8caccdca-a84c-4f26-9b60-a89112b444b0" containerName="maas-api"
Sep 11 19:32:47.363867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.363870    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8caccdca-a84c-4f26-9b60-a89112b444b0" containerName="maas-api"
Sep 11 19:32:47.364031 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.363991    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8caccdca-a84c-4f26-9b60-a89112b444b0" containerName="maas-api"
Sep 11 19:32:47.368662 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.368642    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.370972 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.370950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-f09ed0d7-openshift-default-dockercfg-jcwp6\""
Sep 11 19:32:47.378829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.378804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:32:47.450299 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450264    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450566 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450517    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450642    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450725    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.450885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450845    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.451072 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.450891    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqq9p\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552078 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552078 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552155    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552222    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552260    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552297    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqq9p\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552588    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552786 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552771    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.552894 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.552877    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.553462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.553437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.554972 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.554946    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.555113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.555092    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.564658 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.564633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.564983 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.564964    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqq9p\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p\") pod \"e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") " pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.680414 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.680316    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:47.964527 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.964488    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:32:47.970510 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.970470    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:47.970615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.970539    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:47.970615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.970590    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:32:47.983197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:47.983156    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8caccdca-a84c-4f26-9b60-a89112b444b0" path="/var/lib/kubelet/pods/8caccdca-a84c-4f26-9b60-a89112b444b0/volumes"
Sep 11 19:32:48.367799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:48.367759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerStarted","Data":"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"}
Sep 11 19:32:48.368205 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:48.367808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerStarted","Data":"81d6e5527967f7304ffe4982e6e1e82a51d938f32c1a5e0b28b1f29ee2cc8a57"}
Sep 11 19:32:48.398692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:48.398637    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podStartSLOduration=1.39862199 podStartE2EDuration="1.39862199s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:48.396402465 +0000 UTC m=+890.929458588" watchObservedRunningTime="2026-09-11 19:32:48.39862199 +0000 UTC m=+890.931678110"
Sep 11 19:32:48.680864 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:48.680777    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:49.685913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:49.685882    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:50.380139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:50.380113    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:50.381136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:50.381116    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:32:51.820501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.820467    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:32:51.867089 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.867012    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:51.999353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999417    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999434    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999485    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999598    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:51.999787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999675    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:51.999787 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:51.999923 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999823    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data" (OuterVolumeSpecName: "istio-data") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:51.999923 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999880    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:52.000016 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:51.999911    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:52.000016 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000000    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6sn8k\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k\") pod \"a0d1fb05-0f00-43fe-b298-a253f22af550\" (UID: \"a0d1fb05-0f00-43fe-b298-a253f22af550\") "
Sep 11 19:32:52.000115 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000083    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:52.000232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000212    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:32:52.000495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000406    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.000495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000429    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a0d1fb05-0f00-43fe-b298-a253f22af550-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.000495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000443    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.000495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000458    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.000495 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.000472    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.002161 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.002134    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:32:52.002161 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.002145    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token" (OuterVolumeSpecName: "istio-token") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:52.002307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.002152    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:32:52.002345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.002323    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k" (OuterVolumeSpecName: "kube-api-access-6sn8k") pod "a0d1fb05-0f00-43fe-b298-a253f22af550" (UID: "a0d1fb05-0f00-43fe-b298-a253f22af550"). InnerVolumeSpecName "kube-api-access-6sn8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:32:52.101488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.101444    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6sn8k\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-kube-api-access-6sn8k\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.101488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.101487    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.101706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.101578    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.101706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.101593    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a0d1fb05-0f00-43fe-b298-a253f22af550-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:32:52.392270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.392237    2562 generic.go:356] "Generic (PLEG): container finished" podID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerID="f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f" exitCode=0
Sep 11 19:32:52.392499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.392280    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerDied","Data":"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"}
Sep 11 19:32:52.392499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.392308    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"
Sep 11 19:32:52.392499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.392348    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f" event={"ID":"a0d1fb05-0f00-43fe-b298-a253f22af550","Type":"ContainerDied","Data":"e66b123da9f300b91c17a87eefa853d493d5ce78a051a147add05515b3a4225f"}
Sep 11 19:32:52.392499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.392377    2562 scope.go:117] "RemoveContainer" containerID="f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"
Sep 11 19:32:52.403270 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.403245    2562 scope.go:117] "RemoveContainer" containerID="675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"
Sep 11 19:32:52.413315 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.413288    2562 scope.go:117] "RemoveContainer" containerID="f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"
Sep 11 19:32:52.413643 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:52.413622    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f\": container with ID starting with f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f not found: ID does not exist" containerID="f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"
Sep 11 19:32:52.413726 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.413650    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f"} err="failed to get container status \"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f\": rpc error: code = NotFound desc = could not find container \"f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f\": container with ID starting with f9ad3c9bc9123957d93a4d8d7b569bdc8bc4f9124e97cc2f31115148270a191f not found: ID does not exist"
Sep 11 19:32:52.413726 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.413669    2562 scope.go:117] "RemoveContainer" containerID="675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"
Sep 11 19:32:52.413975 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:52.413951    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1\": container with ID starting with 675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1 not found: ID does not exist" containerID="675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"
Sep 11 19:32:52.414026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.413985    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1"} err="failed to get container status \"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1\": rpc error: code = NotFound desc = could not find container \"675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1\": container with ID starting with 675b5db5ac3c3ec73fd3c3008be59fb8b950d3335639c7a9bfd4f26b6474d8d1 not found: ID does not exist"
Sep 11 19:32:52.417594 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.417571    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:52.421816 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:52.421795    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-846167e5-openshift-default-5b544d4744-nfj9f"]
Sep 11 19:32:53.978745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:53.978710    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" path="/var/lib/kubelet/pods/a0d1fb05-0f00-43fe-b298-a253f22af550/volumes"
Sep 11 19:32:54.111371 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.111337    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:32:54.111985 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.111967    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:32:54.112050 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.111989    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:32:54.112050 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.112014    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:32:54.112050 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.112023    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:32:54.112151 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.112132    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:32:54.115818 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.115798    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.118323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.118302    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-f09ed0d7-serving-cert\""
Sep 11 19:32:54.124088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.123905    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:32:54.221880 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.221851    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.222059 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.221915    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.222059 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.222002    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.222163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.222067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67lfm\" (UniqueName: \"kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.322703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.322609    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.322703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.322670    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.322951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.322735    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67lfm\" (UniqueName: \"kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.322951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.322821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.323590 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:54.322971    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-serving-cert: secret "maas-api-e2e-derive-f09ed0d7-serving-cert" not found
Sep 11 19:32:54.323693 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:32:54.323643    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls podName:e8129b64-6f1c-485d-b7bf-85317566737d nodeName:}" failed. No retries permitted until 2026-09-11 19:32:54.823623295 +0000 UTC m=+897.356679395 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls") pod "maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" (UID: "e8129b64-6f1c-485d-b7bf-85317566737d") : secret "maas-api-e2e-derive-f09ed0d7-serving-cert" not found
Sep 11 19:32:54.323829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.323307    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.325394 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.325355    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.330439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.330417    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67lfm\" (UniqueName: \"kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.828203 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.828154    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:54.831998 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:54.831965    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") pod \"maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:55.028666 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:55.028618    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:55.316373 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:55.316342    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:32:55.317037 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:32:55.317013    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8129b64_6f1c_485d_b7bf_85317566737d.slice/crio-d3076505c468c0ee794514f06982ec7f16b2081600f5976891bc0137ea4a43d0 WatchSource:0}: Error finding container d3076505c468c0ee794514f06982ec7f16b2081600f5976891bc0137ea4a43d0: Status 404 returned error can't find the container with id d3076505c468c0ee794514f06982ec7f16b2081600f5976891bc0137ea4a43d0
Sep 11 19:32:55.412791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:55.412709    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" event={"ID":"e8129b64-6f1c-485d-b7bf-85317566737d","Type":"ContainerStarted","Data":"d3076505c468c0ee794514f06982ec7f16b2081600f5976891bc0137ea4a43d0"}
Sep 11 19:32:56.419847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:56.419808    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" event={"ID":"e8129b64-6f1c-485d-b7bf-85317566737d","Type":"ContainerStarted","Data":"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"}
Sep 11 19:32:56.420315 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:56.419888    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:32:56.437869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:56.437816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" podStartSLOduration=2.088891443 podStartE2EDuration="2.437801336s" totalImagesPullingTime="348.909893ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:32:56.436156077 +0000 UTC m=+898.969212223" watchObservedRunningTime="2026-09-11 19:32:56.437801336 +0000 UTC m=+898.970857457"
Sep 11 19:32:57.960296 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:57.960262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:32:57.962497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:32:57.962472    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:33:02.431478 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:02.431448    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:33:10.806491 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:10.806451    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:33:11.516728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.516698    2562 generic.go:356] "Generic (PLEG): container finished" podID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerID="04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af" exitCode=0
Sep 11 19:33:11.516949 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.516760    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerDied","Data":"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"}
Sep 11 19:33:11.517164 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.517137    2562 scope.go:117] "RemoveContainer" containerID="04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"
Sep 11 19:33:11.518357 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.518322    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:33:11.518465 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.518412    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:33:11.518532 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:11.518471    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:33:12.523889 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:12.523845    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerStarted","Data":"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"}
Sep 11 19:33:12.680748 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:12.680712    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:12.680931 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:12.680901    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 19:33:12.680978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:12.680962    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 19:33:13.681638 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:13.681598    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 19:33:13.682045 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:13.681651    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 19:33:14.681072 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:14.681038    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 19:33:14.681271 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:14.681096    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 19:33:15.681151 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:15.681115    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 19:33:15.681654 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:15.681195    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 19:33:16.681385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:16.681353    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 19:33:16.681855 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:16.681829    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 19:33:17.685498 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:17.685463    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:17.685873 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:17.685763    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:17.686571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:17.686529    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:28.862051 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:28.862014    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:33:31.744163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:31.744109    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:33:31.744661 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:31.744437    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" podUID="e8129b64-6f1c-485d-b7bf-85317566737d" containerName="maas-api" containerID="cri-o://6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148" gracePeriod=30
Sep 11 19:33:32.010582 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.010536    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:33:32.093297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.093260    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:33:32.093557 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.093521    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" containerID="cri-o://b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6" gracePeriod=30
Sep 11 19:33:32.193990 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.193957    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs\") pod \"e8129b64-6f1c-485d-b7bf-85317566737d\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") "
Sep 11 19:33:32.193990 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.193995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") pod \"e8129b64-6f1c-485d-b7bf-85317566737d\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") "
Sep 11 19:33:32.194249 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.194015    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca\") pod \"e8129b64-6f1c-485d-b7bf-85317566737d\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") "
Sep 11 19:33:32.194249 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.194129    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67lfm\" (UniqueName: \"kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm\") pod \"e8129b64-6f1c-485d-b7bf-85317566737d\" (UID: \"e8129b64-6f1c-485d-b7bf-85317566737d\") "
Sep 11 19:33:32.195463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.195430    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e8129b64-6f1c-485d-b7bf-85317566737d" (UID: "e8129b64-6f1c-485d-b7bf-85317566737d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:32.196465 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.196438    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e8129b64-6f1c-485d-b7bf-85317566737d" (UID: "e8129b64-6f1c-485d-b7bf-85317566737d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:33:32.196902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.196871    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e8129b64-6f1c-485d-b7bf-85317566737d" (UID: "e8129b64-6f1c-485d-b7bf-85317566737d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:33:32.197009 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.196984    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm" (OuterVolumeSpecName: "kube-api-access-67lfm") pod "e8129b64-6f1c-485d-b7bf-85317566737d" (UID: "e8129b64-6f1c-485d-b7bf-85317566737d"). InnerVolumeSpecName "kube-api-access-67lfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:32.295389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.295311    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.295389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.295336    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e8129b64-6f1c-485d-b7bf-85317566737d-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.295389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.295345    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e8129b64-6f1c-485d-b7bf-85317566737d-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.295389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.295356    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67lfm\" (UniqueName: \"kubernetes.io/projected/e8129b64-6f1c-485d-b7bf-85317566737d-kube-api-access-67lfm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:32.641155 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.641124    2562 generic.go:356] "Generic (PLEG): container finished" podID="e8129b64-6f1c-485d-b7bf-85317566737d" containerID="6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148" exitCode=0
Sep 11 19:33:32.641361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.641172    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"
Sep 11 19:33:32.641361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.641215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" event={"ID":"e8129b64-6f1c-485d-b7bf-85317566737d","Type":"ContainerDied","Data":"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"}
Sep 11 19:33:32.641361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.641266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m" event={"ID":"e8129b64-6f1c-485d-b7bf-85317566737d","Type":"ContainerDied","Data":"d3076505c468c0ee794514f06982ec7f16b2081600f5976891bc0137ea4a43d0"}
Sep 11 19:33:32.641361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.641294    2562 scope.go:117] "RemoveContainer" containerID="6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"
Sep 11 19:33:32.651650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.651623    2562 scope.go:117] "RemoveContainer" containerID="6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"
Sep 11 19:33:32.651939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:33:32.651914    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148\": container with ID starting with 6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148 not found: ID does not exist" containerID="6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"
Sep 11 19:33:32.652010 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.651951    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148"} err="failed to get container status \"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148\": rpc error: code = NotFound desc = could not find container \"6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148\": container with ID starting with 6c33d4274a26dc30af9f51785e87c757dd1f2bf318725c1e6bcdc4bf70d70148 not found: ID does not exist"
Sep 11 19:33:32.663214 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.663178    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:33:32.665240 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.665219    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-f09ed0d7-d84589cdd-7wz4m"]
Sep 11 19:33:32.688606 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.688570    2562 patch_prober.go:28] interesting pod/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:33:32.688722 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:32.688667    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:33:33.985651 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:33.985615    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8129b64-6f1c-485d-b7bf-85317566737d" path="/var/lib/kubelet/pods/e8129b64-6f1c-485d-b7bf-85317566737d/volumes"
Sep 11 19:33:37.354450 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.354419    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:37.544171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544088    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544138    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544169    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544201    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544232    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544290    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544344    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544391    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:33:37.544732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544447    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqq9p\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544567    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs\") pod \"1e042972-23f0-4b92-8a32-90e3d3065a4f\" (UID: \"1e042972-23f0-4b92-8a32-90e3d3065a4f\") "
Sep 11 19:33:37.544732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544564    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:33:37.544880 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544724    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:33:37.544880 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544776    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:33:37.544982 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544939    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:33:37.544982 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544973    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.545070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.544990    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.545070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.545004    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1e042972-23f0-4b92-8a32-90e3d3065a4f-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.545070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.545016    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.546791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.546757    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:33:37.546913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.546853    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:33:37.546913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.546899    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:37.547136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.547104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p" (OuterVolumeSpecName: "kube-api-access-vqq9p") pod "1e042972-23f0-4b92-8a32-90e3d3065a4f" (UID: "1e042972-23f0-4b92-8a32-90e3d3065a4f"). InnerVolumeSpecName "kube-api-access-vqq9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:33:37.645745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.645709    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.645745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.645740    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqq9p\" (UniqueName: \"kubernetes.io/projected/1e042972-23f0-4b92-8a32-90e3d3065a4f-kube-api-access-vqq9p\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.645745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.645750    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.646056 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.645759    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.646056 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.645768    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1e042972-23f0-4b92-8a32-90e3d3065a4f-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:33:37.671921 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.671888    2562 generic.go:356] "Generic (PLEG): container finished" podID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerID="b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6" exitCode=0
Sep 11 19:33:37.672093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.671933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"
Sep 11 19:33:37.672093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.671969    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerDied","Data":"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"}
Sep 11 19:33:37.672093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.672021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn" event={"ID":"1e042972-23f0-4b92-8a32-90e3d3065a4f","Type":"ContainerDied","Data":"81d6e5527967f7304ffe4982e6e1e82a51d938f32c1a5e0b28b1f29ee2cc8a57"}
Sep 11 19:33:37.672093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.672044    2562 scope.go:117] "RemoveContainer" containerID="b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"
Sep 11 19:33:37.681343 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.681323    2562 scope.go:117] "RemoveContainer" containerID="04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"
Sep 11 19:33:37.689797 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.689780    2562 scope.go:117] "RemoveContainer" containerID="b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"
Sep 11 19:33:37.690059 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:33:37.690040    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6\": container with ID starting with b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6 not found: ID does not exist" containerID="b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"
Sep 11 19:33:37.690111 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.690067    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6"} err="failed to get container status \"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6\": rpc error: code = NotFound desc = could not find container \"b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6\": container with ID starting with b42b7a53a6fb7d41f5a95463e0b6448a7fe492ce9d6c16d690149c25d4457fc6 not found: ID does not exist"
Sep 11 19:33:37.690111 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.690088    2562 scope.go:117] "RemoveContainer" containerID="04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"
Sep 11 19:33:37.690343 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:33:37.690326    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af\": container with ID starting with 04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af not found: ID does not exist" containerID="04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"
Sep 11 19:33:37.690399 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.690352    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af"} err="failed to get container status \"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af\": rpc error: code = NotFound desc = could not find container \"04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af\": container with ID starting with 04499c643155cf46f428325d2f204de83fd95796d6f8ffbac85f4c52eb9168af not found: ID does not exist"
Sep 11 19:33:37.696557 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.696518    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:33:37.700321 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.700302    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-f09ed0d7-openshift-default-5d8f95c976-98dkn"]
Sep 11 19:33:37.979279 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:37.979246    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" path="/var/lib/kubelet/pods/1e042972-23f0-4b92-8a32-90e3d3065a4f/volumes"
Sep 11 19:33:44.211829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.211787    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:33:44.212404 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212382    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8129b64-6f1c-485d-b7bf-85317566737d" containerName="maas-api"
Sep 11 19:33:44.212488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212408    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8129b64-6f1c-485d-b7bf-85317566737d" containerName="maas-api"
Sep 11 19:33:44.212488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212423    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:33:44.212488 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212431    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:33:44.212688 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212671    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0d1fb05-0f00-43fe-b298-a253f22af550" containerName="istio-proxy"
Sep 11 19:33:44.212744 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212697    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:33:44.212744 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212705    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:33:44.212744 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.212716    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8129b64-6f1c-485d-b7bf-85317566737d" containerName="maas-api"
Sep 11 19:33:44.217337 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.217315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.221923 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.221899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a0610b\"/\"openshift-service-ca.crt\""
Sep 11 19:33:44.221923 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.221907    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-a0610b\"/\"kube-root-ca.crt\""
Sep 11 19:33:44.222089 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.221907    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a0610b\"/\"default-dockercfg-6hjb4\""
Sep 11 19:33:44.222089 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.221909    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-a0610b\"/\"test-model-a0610b-kserve-self-signed-certs\""
Sep 11 19:33:44.226514 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.226491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:33:44.310278 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.310278 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.310493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310320    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.310493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310355    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.310493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.310493 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.310467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtxw\" (UniqueName: \"kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.411942 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.411901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtxw\" (UniqueName: \"kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.411957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412119 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412069    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412260    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412456 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412432    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.412541 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.412518    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.414395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.414370    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.414713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.414692    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.421189 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.421167    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtxw\" (UniqueName: \"kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw\") pod \"test-model-a0610b-kserve-77d567847c-n4pfp\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") " pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.527679 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.527596    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:44.801356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:44.801331    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:33:44.803409 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:33:44.803379    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6d6a230d_63fa_4201_9d18_0eb4cabe5f86.slice/crio-13236d8bb4ea5a378ec47b1d5b316053027add5e8c6a4c5c73524c95cdfdebad WatchSource:0}: Error finding container 13236d8bb4ea5a378ec47b1d5b316053027add5e8c6a4c5c73524c95cdfdebad: Status 404 returned error can't find the container with id 13236d8bb4ea5a378ec47b1d5b316053027add5e8c6a4c5c73524c95cdfdebad
Sep 11 19:33:45.718669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:45.718634    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" event={"ID":"6d6a230d-63fa-4201-9d18-0eb4cabe5f86","Type":"ContainerStarted","Data":"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"}
Sep 11 19:33:45.719032 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:45.718680    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" event={"ID":"6d6a230d-63fa-4201-9d18-0eb4cabe5f86","Type":"ContainerStarted","Data":"13236d8bb4ea5a378ec47b1d5b316053027add5e8c6a4c5c73524c95cdfdebad"}
Sep 11 19:33:45.736458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:45.736407    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" podStartSLOduration=1.736392296 podStartE2EDuration="1.736392296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:33:45.734381904 +0000 UTC m=+948.267438029" watchObservedRunningTime="2026-09-11 19:33:45.736392296 +0000 UTC m=+948.269448417"
Sep 11 19:33:51.305139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:51.305097    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:33:54.528134 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:54.528100    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:54.528618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:54.528150    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:54.540718 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:54.540685    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:33:54.779982 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:33:54.779896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:34:18.100675 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:18.100638    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:34:37.306049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:37.306012    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:34:54.691631 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:54.691595    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:34:54.692221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:54.691871    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy" containerID="cri-o://a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb" gracePeriod=30
Sep 11 19:34:59.116617 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:59.116580    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:34:59.954746 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:34:59.954681    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:35:00.041589 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041530    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041608    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041628    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041654    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041679    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041719    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.041791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041758    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h4mf6\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041799    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs\") pod \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\" (UID: \"63e60f7c-8df2-46dd-9fb1-b2c7daca954c\") "
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041860    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.041963    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042017    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:00.042121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042129    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data" (OuterVolumeSpecName: "istio-data") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042266    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042285    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042299    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042311    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.042434 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.042324    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.044123 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.044098    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6" (OuterVolumeSpecName: "kube-api-access-h4mf6") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "kube-api-access-h4mf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:35:00.044360 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.044342    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:35:00.044449 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.044437    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:35:00.045281 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.045254    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token" (OuterVolumeSpecName: "istio-token") pod "63e60f7c-8df2-46dd-9fb1-b2c7daca954c" (UID: "63e60f7c-8df2-46dd-9fb1-b2c7daca954c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:35:00.124048 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.124016    2562 generic.go:356] "Generic (PLEG): container finished" podID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerID="a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb" exitCode=0
Sep 11 19:35:00.124502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.124074    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"
Sep 11 19:35:00.124502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.124105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerDied","Data":"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"}
Sep 11 19:35:00.124502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.124173    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf" event={"ID":"63e60f7c-8df2-46dd-9fb1-b2c7daca954c","Type":"ContainerDied","Data":"19de39ac133c26431e2308be1150bddf1d58bda88a6eeaf72c22bf3ac3955bfd"}
Sep 11 19:35:00.124502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.124208    2562 scope.go:117] "RemoveContainer" containerID="a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"
Sep 11 19:35:00.133468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.133449    2562 scope.go:117] "RemoveContainer" containerID="2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"
Sep 11 19:35:00.141951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.141932    2562 scope.go:117] "RemoveContainer" containerID="a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"
Sep 11 19:35:00.142212 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:35:00.142191    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb\": container with ID starting with a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb not found: ID does not exist" containerID="a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"
Sep 11 19:35:00.142277 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142218    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb"} err="failed to get container status \"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb\": rpc error: code = NotFound desc = could not find container \"a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb\": container with ID starting with a1c9b41198f6b5b493d004ad5764c6fc8b47b5f17dec1cff7aef33565bdc86fb not found: ID does not exist"
Sep 11 19:35:00.142277 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142233    2562 scope.go:117] "RemoveContainer" containerID="2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"
Sep 11 19:35:00.142505 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:35:00.142484    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa\": container with ID starting with 2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa not found: ID does not exist" containerID="2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"
Sep 11 19:35:00.142591 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142511    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa"} err="failed to get container status \"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa\": rpc error: code = NotFound desc = could not find container \"2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa\": container with ID starting with 2fc9b644b0612f5667b1bde2c1db093b167f3051923e3a894f3c8d510ac3ebaa not found: ID does not exist"
Sep 11 19:35:00.142822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142807    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.142879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142823    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.142879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142830    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.142879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.142839    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h4mf6\" (UniqueName: \"kubernetes.io/projected/63e60f7c-8df2-46dd-9fb1-b2c7daca954c-kube-api-access-h4mf6\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:35:00.146096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.146064    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:35:00.154201 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:00.154175    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-6afc47-openshift-default-78f97cc488-lnmcf"]
Sep 11 19:35:01.120274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120240    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:35:01.120931 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120913    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.120985 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120935    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.120985 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120951    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.120985 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120960    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.121100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120984    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:35:01.121100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.120993    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e042972-23f0-4b92-8a32-90e3d3065a4f" containerName="istio-proxy"
Sep 11 19:35:01.121181 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.121120    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.121181 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.121132    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" containerName="istio-proxy"
Sep 11 19:35:01.125681 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.125652    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.128650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.128624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-472add-serving-cert\""
Sep 11 19:35:01.151936 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.151860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.152190 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.152170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qmn5\" (UniqueName: \"kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.152392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.152365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.152471 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.152449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.152537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.152524    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:35:01.253890 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.253857    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.254084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.253902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qmn5\" (UniqueName: \"kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.254084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.253957    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.254084 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.253977    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.254321 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:35:01.254084    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-472add-serving-cert: secret "maas-api-e2e-explicit-472add-serving-cert" not found
Sep 11 19:35:01.254321 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:35:01.254154    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls podName:470e7c65-0308-458e-b8dc-97f031310338 nodeName:}" failed. No retries permitted until 2026-09-11 19:35:01.754132512 +0000 UTC m=+1024.287188612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls") pod "maas-api-e2e-explicit-472add-75469f6bb4-td28l" (UID: "470e7c65-0308-458e-b8dc-97f031310338") : secret "maas-api-e2e-explicit-472add-serving-cert" not found
Sep 11 19:35:01.254949 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.254926    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.256574 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.256536    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.267150 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.267126    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qmn5\" (UniqueName: \"kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.760019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.759984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.762420 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.762393    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") pod \"maas-api-e2e-explicit-472add-75469f6bb4-td28l\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:01.980639 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:01.980604    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e60f7c-8df2-46dd-9fb1-b2c7daca954c" path="/var/lib/kubelet/pods/63e60f7c-8df2-46dd-9fb1-b2c7daca954c/volumes"
Sep 11 19:35:02.046180 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:02.046081    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:02.319397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:02.319371    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:35:02.320953 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:35:02.320927    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod470e7c65_0308_458e_b8dc_97f031310338.slice/crio-00856b2d4cd8a8245eb754d9f5a2f5da813ae619e70331abd3d86d6f7976cade WatchSource:0}: Error finding container 00856b2d4cd8a8245eb754d9f5a2f5da813ae619e70331abd3d86d6f7976cade: Status 404 returned error can't find the container with id 00856b2d4cd8a8245eb754d9f5a2f5da813ae619e70331abd3d86d6f7976cade
Sep 11 19:35:02.322585 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:02.322566    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:35:03.168579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:03.168527    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" event={"ID":"470e7c65-0308-458e-b8dc-97f031310338","Type":"ContainerStarted","Data":"b1505bb57e07764a29f6e47fc8233269c7be70977a940dc0a2edf0a4dcc60f58"}
Sep 11 19:35:03.168763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:03.168611    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:03.168763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:03.168630    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" event={"ID":"470e7c65-0308-458e-b8dc-97f031310338","Type":"ContainerStarted","Data":"00856b2d4cd8a8245eb754d9f5a2f5da813ae619e70331abd3d86d6f7976cade"}
Sep 11 19:35:03.186071 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:03.186017    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" podStartSLOduration=1.5044943339999999 podStartE2EDuration="2.186002596s" totalImagesPullingTime="681.508262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:03.183853256 +0000 UTC m=+1025.716909377" watchObservedRunningTime="2026-09-11 19:35:03.186002596 +0000 UTC m=+1025.719058717"
Sep 11 19:35:08.968347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:08.968312    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:35:08.972970 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:08.972770    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:08.975846 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:08.975824    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-20a8f069-openshift-default-dockercfg-q9fjv\""
Sep 11 19:35:08.983443 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:08.983417    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:35:09.031978 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.031945    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.031982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jtck\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032010    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032106    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032152 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032215    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.032407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.032280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.132876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.132834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.132876 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.132881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.132911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.132942    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.132982    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133022    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133143 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133414 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133203    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133414 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133257    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jtck\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133414 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133287    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133590 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133484    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133590 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133536    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133708    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.133847 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.133829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.135470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.135452    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.135566 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.135504    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.141280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.141262    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.141461 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.141437    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jtck\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck\") pod \"e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") " pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.181225 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.181198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:35:09.286447 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.286365    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:09.573816 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.573788    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:35:09.576248 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:35:09.576221    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e073d41_c38a_450d_a364_b1e3294b4822.slice/crio-73bcf56db3d1f28816e54df4c62a5e2054678aab886f68df9f9c3eaa89a744b5 WatchSource:0}: Error finding container 73bcf56db3d1f28816e54df4c62a5e2054678aab886f68df9f9c3eaa89a744b5: Status 404 returned error can't find the container with id 73bcf56db3d1f28816e54df4c62a5e2054678aab886f68df9f9c3eaa89a744b5
Sep 11 19:35:09.578993 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.578958    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:09.579106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.579038    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:09.579106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:09.579082    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:10.209126 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.209083    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerStarted","Data":"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"}
Sep 11 19:35:10.209616 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.209155    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerStarted","Data":"73bcf56db3d1f28816e54df4c62a5e2054678aab886f68df9f9c3eaa89a744b5"}
Sep 11 19:35:10.235396 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.235334    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podStartSLOduration=2.235312907 podStartE2EDuration="2.235312907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:35:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:35:10.233090876 +0000 UTC m=+1032.766147016" watchObservedRunningTime="2026-09-11 19:35:10.235312907 +0000 UTC m=+1032.768369029"
Sep 11 19:35:10.286606 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.286570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:10.288569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.288513    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:10.288723 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:10.288605    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:11.295463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:11.295427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:12.219727 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:12.219694    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:12.220678 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:12.220655    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:17.529539 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:17.529504    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:35:34.344705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.344672    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e073d41-c38a-450d-a364-b1e3294b4822" containerID="96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16" exitCode=0
Sep 11 19:35:34.345138 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.344743    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerDied","Data":"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"}
Sep 11 19:35:34.345215 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.345172    2562 scope.go:117] "RemoveContainer" containerID="96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"
Sep 11 19:35:34.350280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.349769    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:34.350280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.349856    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:34.350280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:34.349905    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:35:35.353946 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:35.353912    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerStarted","Data":"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"}
Sep 11 19:35:36.287101 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:36.287064    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:36.287295 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:36.287270    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:36.287355 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:36.287335    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:37.287019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:37.286978    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:37.287490 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:37.287058    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:37.722407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:37.722373    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:35:38.287229 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:38.287185    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:38.287744 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:38.287255    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:39.286998 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:39.286964    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:39.287182 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:39.287036    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:40.287425 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:40.287386    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 11 19:35:40.287831 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:40.287452    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 11 19:35:41.371964 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:41.371927    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:41.372451 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:41.372361    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:41.374269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:41.374225    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:35:57.007114 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:35:57.007033    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:36:09.557202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:09.557169    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:36:09.557817 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:09.557372    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" containerID="cri-o://f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550" gracePeriod=30
Sep 11 19:36:11.375020 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:11.374985    2562 patch_prober.go:28] interesting pod/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:36:11.375392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:11.375051    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:36:12.405018 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:12.404984    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:36:14.814590 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.814541    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:36:14.965645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965645 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965654    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7jtck\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965725    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965760    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965795    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.965901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965869    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.966209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.965922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data\") pod \"7e073d41-c38a-450d-a364-b1e3294b4822\" (UID: \"7e073d41-c38a-450d-a364-b1e3294b4822\") "
Sep 11 19:36:14.966209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966015    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:36:14.966209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966091    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:36:14.966209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966179    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:36:14.966418 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966284    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data" (OuterVolumeSpecName: "istio-data") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:36:14.966418 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966337    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:36:14.966418 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966395    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:14.966418 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966412    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:14.966696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966426    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e073d41-c38a-450d-a364-b1e3294b4822-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:14.966696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.966438    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:14.968058 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.968024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck" (OuterVolumeSpecName: "kube-api-access-7jtck") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "kube-api-access-7jtck". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:36:14.968175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.968073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:36:14.968175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.968109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:36:14.968256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:14.968186    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token" (OuterVolumeSpecName: "istio-token") pod "7e073d41-c38a-450d-a364-b1e3294b4822" (UID: "7e073d41-c38a-450d-a364-b1e3294b4822"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:36:15.067094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.067057    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:15.067094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.067087    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7jtck\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-kube-api-access-7jtck\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:15.067094 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.067097    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e073d41-c38a-450d-a364-b1e3294b4822-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:15.067334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.067106    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e073d41-c38a-450d-a364-b1e3294b4822-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:15.067334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.067114    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e073d41-c38a-450d-a364-b1e3294b4822-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:36:15.584113 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.584078    2562 generic.go:356] "Generic (PLEG): container finished" podID="7e073d41-c38a-450d-a364-b1e3294b4822" containerID="f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550" exitCode=0
Sep 11 19:36:15.584297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.584122    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"
Sep 11 19:36:15.584297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.584126    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerDied","Data":"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"}
Sep 11 19:36:15.584297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.584174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx" event={"ID":"7e073d41-c38a-450d-a364-b1e3294b4822","Type":"ContainerDied","Data":"73bcf56db3d1f28816e54df4c62a5e2054678aab886f68df9f9c3eaa89a744b5"}
Sep 11 19:36:15.584297 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.584196    2562 scope.go:117] "RemoveContainer" containerID="f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"
Sep 11 19:36:15.593763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.593744    2562 scope.go:117] "RemoveContainer" containerID="96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"
Sep 11 19:36:15.602068 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.602050    2562 scope.go:117] "RemoveContainer" containerID="f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"
Sep 11 19:36:15.602409 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:36:15.602385    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550\": container with ID starting with f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550 not found: ID does not exist" containerID="f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"
Sep 11 19:36:15.602497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.602416    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550"} err="failed to get container status \"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550\": rpc error: code = NotFound desc = could not find container \"f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550\": container with ID starting with f7667d211c482860dee14a9f385c71e7825f4599264d5ddb8d62773ffa021550 not found: ID does not exist"
Sep 11 19:36:15.602497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.602441    2562 scope.go:117] "RemoveContainer" containerID="96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"
Sep 11 19:36:15.602779 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:36:15.602753    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16\": container with ID starting with 96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16 not found: ID does not exist" containerID="96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"
Sep 11 19:36:15.602922 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.602786    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16"} err="failed to get container status \"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16\": rpc error: code = NotFound desc = could not find container \"96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16\": container with ID starting with 96bf7bf7c156aa07e42f69db56aaaecb75a6b07f3a3c04bf0780fffb0b326c16 not found: ID does not exist"
Sep 11 19:36:15.605121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.605103    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:36:15.609009 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.608983    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-20a8f069-openshift-default-775c598fb8-qv7lx"]
Sep 11 19:36:15.979703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:15.979619    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" path="/var/lib/kubelet/pods/7e073d41-c38a-450d-a364-b1e3294b4822/volumes"
Sep 11 19:36:23.198712 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.198662    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:36:23.200452 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.200428    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:23.200642 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.200628    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:23.201065 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.201049    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:23.210705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.210674    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.214100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.212950    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:36:23.214100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.213847    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-b5bf35-openshift-default-dockercfg-42672\""
Sep 11 19:36:23.343330 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343291    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8npz\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343526 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343526 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343400    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343526 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343526 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343491    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343746 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343746 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343746 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.343746 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.343649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445157 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445177    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8npz\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445214    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445252    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445503 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445383    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445503 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445665 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445665 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445585    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445665 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445605    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445753    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445860    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445945 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445921    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.445999 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.445973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.446992 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.446970    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.448153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.448127    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.448813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.448754    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.453781 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.453760    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8npz\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.454155 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.454131    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token\") pod \"e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") " pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.524316 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.524275    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:23.800525 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.800491    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:36:23.802380 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:36:23.802332    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc621e364_7038_41f5_9ce9_34196ef152e3.slice/crio-e76376be37ffd35ed110e2048dd28998addb81e392f646b605a5e4b350a408af WatchSource:0}: Error finding container e76376be37ffd35ed110e2048dd28998addb81e392f646b605a5e4b350a408af: Status 404 returned error can't find the container with id e76376be37ffd35ed110e2048dd28998addb81e392f646b605a5e4b350a408af
Sep 11 19:36:23.805245 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.805209    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:23.805347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.805289    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:23.805347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:23.805334    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:24.635535 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:24.635499    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerStarted","Data":"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"}
Sep 11 19:36:24.636036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:24.635582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerStarted","Data":"e76376be37ffd35ed110e2048dd28998addb81e392f646b605a5e4b350a408af"}
Sep 11 19:36:24.656380 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:24.656330    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podStartSLOduration=1.6563126110000002 podStartE2EDuration="1.656312611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:24.654715504 +0000 UTC m=+1107.187771642" watchObservedRunningTime="2026-09-11 19:36:24.656312611 +0000 UTC m=+1107.189368732"
Sep 11 19:36:25.525235 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:25.525198    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:25.530239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:25.530214    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:25.640559 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:25.640502    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:25.641530 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:25.641503    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:39.513220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:39.513183    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:36:50.790571 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.790516    2562 generic.go:356] "Generic (PLEG): container finished" podID="c621e364-7038-41f5-9ce9-34196ef152e3" containerID="f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11" exitCode=0
Sep 11 19:36:50.790992 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.790582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerDied","Data":"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"}
Sep 11 19:36:50.791037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.791010    2562 scope.go:117] "RemoveContainer" containerID="f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"
Sep 11 19:36:50.792142 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.792115    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:50.792206 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.792183    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:50.792243 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:50.792212    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:51.798219 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:51.798176    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerStarted","Data":"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"}
Sep 11 19:36:52.524816 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:52.524776    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:52.525959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:52.525930    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:36:52.526072 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:52.525992    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 19:36:53.525042 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:53.525006    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:36:53.525416 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:53.525066    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 19:36:54.524886 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:54.524850    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:36:54.525065 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:54.524921    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 19:36:55.525575 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:55.525527    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:36:55.525981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:55.525599    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 19:36:55.640460 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:55.640360    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:56.524934 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:56.524895    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 19:36:56.525132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:56.524962    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 19:36:57.298670 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.298640    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:36:57.299129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.299065    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:57.299129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.299077    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:57.299211 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.299140    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e073d41-c38a-450d-a364-b1e3294b4822" containerName="istio-proxy"
Sep 11 19:36:57.302314 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.302297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.305026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.305006    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b20815-openshift-default-dockercfg-64jbc\""
Sep 11 19:36:57.317285 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.317261    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:36:57.399920 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.399889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.399936    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqtfz\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.399968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400067    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400097    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400181    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.400395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.400227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501014    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501063    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqtfz\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501086    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501397 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501560 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501531    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501700 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501679    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501755 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501844 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501827    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501907 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501875    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501950 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501899    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.501950 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.501903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.502088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.502061    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.502202 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.502118    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.502342 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.502322    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.503655 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.503633    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.504323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.504299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.508962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.508939    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.509563 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.509528    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqtfz\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz\") pod \"e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") " pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.528990 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.528962    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:57.530137 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.530118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:36:57.616403 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.616370    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:57.901395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.901366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:36:57.901774 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:36:57.901751    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38eaff01_c54e_4545_8d2f_98110e01a156.slice/crio-6e883a2aff2fa716c7734ee2e5c15a0fc4d85cbe39e0e8dfd37ebc168791169e WatchSource:0}: Error finding container 6e883a2aff2fa716c7734ee2e5c15a0fc4d85cbe39e0e8dfd37ebc168791169e: Status 404 returned error can't find the container with id 6e883a2aff2fa716c7734ee2e5c15a0fc4d85cbe39e0e8dfd37ebc168791169e
Sep 11 19:36:57.904222 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.904188    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:57.904323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.904265    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:57.904323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:57.904301    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:36:58.838800 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:58.838759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerStarted","Data":"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"}
Sep 11 19:36:58.839184 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:58.838815    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerStarted","Data":"6e883a2aff2fa716c7734ee2e5c15a0fc4d85cbe39e0e8dfd37ebc168791169e"}
Sep 11 19:36:58.860969 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:58.860918    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podStartSLOduration=1.860902234 podStartE2EDuration="1.860902234s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:36:58.85803051 +0000 UTC m=+1141.391086648" watchObservedRunningTime="2026-09-11 19:36:58.860902234 +0000 UTC m=+1141.393958355"
Sep 11 19:36:59.617120 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:59.617087    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:59.622430 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:59.622405    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:59.846124 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:59.846091    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:36:59.847413 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:36:59.847388    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:37:02.647829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.647793    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:37:02.648298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.648046    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" podUID="470e7c65-0308-458e-b8dc-97f031310338" containerName="maas-api" containerID="cri-o://b1505bb57e07764a29f6e47fc8233269c7be70977a940dc0a2edf0a4dcc60f58" gracePeriod=30
Sep 11 19:37:02.868680 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.868641    2562 generic.go:356] "Generic (PLEG): container finished" podID="470e7c65-0308-458e-b8dc-97f031310338" containerID="b1505bb57e07764a29f6e47fc8233269c7be70977a940dc0a2edf0a4dcc60f58" exitCode=0
Sep 11 19:37:02.868854 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.868775    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" event={"ID":"470e7c65-0308-458e-b8dc-97f031310338","Type":"ContainerDied","Data":"b1505bb57e07764a29f6e47fc8233269c7be70977a940dc0a2edf0a4dcc60f58"}
Sep 11 19:37:02.920085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.920054    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:37:02.962401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.962357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") pod \"470e7c65-0308-458e-b8dc-97f031310338\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") "
Sep 11 19:37:02.962602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.962458    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qmn5\" (UniqueName: \"kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5\") pod \"470e7c65-0308-458e-b8dc-97f031310338\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") "
Sep 11 19:37:02.962602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.962525    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs\") pod \"470e7c65-0308-458e-b8dc-97f031310338\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") "
Sep 11 19:37:02.962602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.962569    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca\") pod \"470e7c65-0308-458e-b8dc-97f031310338\" (UID: \"470e7c65-0308-458e-b8dc-97f031310338\") "
Sep 11 19:37:02.963023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.962992    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "470e7c65-0308-458e-b8dc-97f031310338" (UID: "470e7c65-0308-458e-b8dc-97f031310338"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:37:02.965138 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.965104    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "470e7c65-0308-458e-b8dc-97f031310338" (UID: "470e7c65-0308-458e-b8dc-97f031310338"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:02.965138 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.965132    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5" (OuterVolumeSpecName: "kube-api-access-7qmn5") pod "470e7c65-0308-458e-b8dc-97f031310338" (UID: "470e7c65-0308-458e-b8dc-97f031310338"). InnerVolumeSpecName "kube-api-access-7qmn5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:37:02.965327 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:02.965154    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "470e7c65-0308-458e-b8dc-97f031310338" (UID: "470e7c65-0308-458e-b8dc-97f031310338"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:37:03.063895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.063854    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.063895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.063893    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/470e7c65-0308-458e-b8dc-97f031310338-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.064163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.063908    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/470e7c65-0308-458e-b8dc-97f031310338-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.064163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.063921    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qmn5\" (UniqueName: \"kubernetes.io/projected/470e7c65-0308-458e-b8dc-97f031310338-kube-api-access-7qmn5\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:37:03.877171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.877126    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"
Sep 11 19:37:03.877171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.877141    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l" event={"ID":"470e7c65-0308-458e-b8dc-97f031310338","Type":"ContainerDied","Data":"00856b2d4cd8a8245eb754d9f5a2f5da813ae619e70331abd3d86d6f7976cade"}
Sep 11 19:37:03.877735 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.877237    2562 scope.go:117] "RemoveContainer" containerID="b1505bb57e07764a29f6e47fc8233269c7be70977a940dc0a2edf0a4dcc60f58"
Sep 11 19:37:03.902696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.902658    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:37:03.906765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.906742    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-472add-75469f6bb4-td28l"]
Sep 11 19:37:03.979476 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:03.979446    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="470e7c65-0308-458e-b8dc-97f031310338" path="/var/lib/kubelet/pods/470e7c65-0308-458e-b8dc-97f031310338/volumes"
Sep 11 19:37:04.854928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.854892    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:37:04.855560 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.855526    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="470e7c65-0308-458e-b8dc-97f031310338" containerName="maas-api"
Sep 11 19:37:04.855658 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.855607    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="470e7c65-0308-458e-b8dc-97f031310338" containerName="maas-api"
Sep 11 19:37:04.855728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.855716    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="470e7c65-0308-458e-b8dc-97f031310338" containerName="maas-api"
Sep 11 19:37:04.860918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.860894    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.863943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.863922    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b20815-serving-cert\""
Sep 11 19:37:04.870859 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.870832    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:37:04.880367 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.880346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82dfg\" (UniqueName: \"kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.880750 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.880412    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.880750 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.880511    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.880750 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.880595    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.981675 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.981639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.981675 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.981678    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.981930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.981745    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82dfg\" (UniqueName: \"kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.981930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.981779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.982443 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.982422    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.984097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.984071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.984200 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.984107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:04.992206 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:04.992178    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82dfg\" (UniqueName: \"kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg\") pod \"maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:05.174774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:05.174695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:05.448810 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:05.448779    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:37:05.451197 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:37:05.451162    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc46cd3fa_5992_447a_8e56_b8b648019f13.slice/crio-5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9 WatchSource:0}: Error finding container 5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9: Status 404 returned error can't find the container with id 5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9
Sep 11 19:37:05.890952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:05.890918    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" event={"ID":"c46cd3fa-5992-447a-8e56-b8b648019f13","Type":"ContainerStarted","Data":"5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9"}
Sep 11 19:37:06.898050 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:06.898017    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" event={"ID":"c46cd3fa-5992-447a-8e56-b8b648019f13","Type":"ContainerStarted","Data":"52a038a71639ee81180d7df548309ff9b11fc28d6cf7e29714a9134067d627e6"}
Sep 11 19:37:06.898453 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:06.898074    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:06.918274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:06.918223    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" podStartSLOduration=2.3836154130000002 podStartE2EDuration="2.918207796s" totalImagesPullingTime="534.592383ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:37:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:37:06.917328161 +0000 UTC m=+1149.450384306" watchObservedRunningTime="2026-09-11 19:37:06.918207796 +0000 UTC m=+1149.451263917"
Sep 11 19:37:12.908139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:12.908109    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:37:16.610593 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:16.610536    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:37:27.019758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.019662    2562 generic.go:356] "Generic (PLEG): container finished" podID="38eaff01-c54e-4545-8d2f-98110e01a156" containerID="d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb" exitCode=0
Sep 11 19:37:27.019758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.019738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerDied","Data":"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"}
Sep 11 19:37:27.020174 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.020158    2562 scope.go:117] "RemoveContainer" containerID="d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"
Sep 11 19:37:27.021463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.021429    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:27.021597 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.021505    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:27.021597 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:27.021572    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:28.027501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:28.027461    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerStarted","Data":"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"}
Sep 11 19:37:28.616868 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:28.616830    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:37:28.618037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:28.618013    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:37:28.618153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:28.618081    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 19:37:29.617030 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:29.617001    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:37:29.617396 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:29.617051    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 19:37:29.846179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:29.846146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:37:30.617097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:30.617061    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:37:30.617467 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:30.617121    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 19:37:31.617389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:31.617348    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:37:31.617811 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:31.617416    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 19:37:32.617466 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:32.617421    2562 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 19:37:32.617857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:32.617492    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 19:37:33.621358 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:33.621325    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:37:33.622463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:33.622440    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:37:40.471649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.471616    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:37:40.476639 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.476614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.479310 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.479285    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-55586842-openshift-default-dockercfg-hhgn8\""
Sep 11 19:37:40.488007 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.487985    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:37:40.551122 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551313 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551313 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzk8c\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551313 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551332    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.551468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.551453    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.652738 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.652693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.652738 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.652743    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653006 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.652761    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653006 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.652933    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653006 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.652976    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653074    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653108    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653185 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653168    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzk8c\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653181    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653205    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653593 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653568    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653593    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.653839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.653812    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.654065 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.654045    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.655327 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.655299    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.655958 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.655938    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.661255 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.661224    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.661751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.661731    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzk8c\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c\") pod \"e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") " pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:40.788053 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:40.787940    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:41.068459 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:41.068436    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:37:41.071299 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:37:41.071268    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f31393_b88c_466c_9f3d_5c1716d1d43b.slice/crio-97e5401a9b07a3550045f71c6ab9e9ff75074663e465d67340508ee6007aba61 WatchSource:0}: Error finding container 97e5401a9b07a3550045f71c6ab9e9ff75074663e465d67340508ee6007aba61: Status 404 returned error can't find the container with id 97e5401a9b07a3550045f71c6ab9e9ff75074663e465d67340508ee6007aba61
Sep 11 19:37:41.073517 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:41.073481    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:41.073641 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:41.073577    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:41.073641 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:41.073627    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:37:41.104462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:41.104433    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerStarted","Data":"97e5401a9b07a3550045f71c6ab9e9ff75074663e465d67340508ee6007aba61"}
Sep 11 19:37:42.111141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:42.111105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerStarted","Data":"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"}
Sep 11 19:37:42.130850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:42.130790    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podStartSLOduration=2.130767653 podStartE2EDuration="2.130767653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:37:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:37:42.130349678 +0000 UTC m=+1184.663405801" watchObservedRunningTime="2026-09-11 19:37:42.130767653 +0000 UTC m=+1184.663823775"
Sep 11 19:37:42.788596 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:42.788513    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:42.794068 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:42.794037    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:43.116387 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:43.116352    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:43.117356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:43.117333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:37:47.510101 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:47.510062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:37:57.995869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:57.995836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:37:57.998755 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:57.998730    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:37:58.078776 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:37:58.078744    2562 scope.go:117] "RemoveContainer" containerID="afa0b3401bbfbd80619e452c37acc539eb836f38575b9db7bed281b40932d871"
Sep 11 19:38:07.256102 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.256022    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerID="6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f" exitCode=0
Sep 11 19:38:07.256102 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.256085    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerDied","Data":"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"}
Sep 11 19:38:07.256569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.256524    2562 scope.go:117] "RemoveContainer" containerID="6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"
Sep 11 19:38:07.257809 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.257775    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:38:07.257902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.257866    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:38:07.257942 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:07.257900    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:38:08.269779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:08.269742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerStarted","Data":"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"}
Sep 11 19:38:08.788663 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:08.788626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:38:08.789987 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:08.789957    2562 patch_prober.go:28] interesting pod/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 19:38:08.790133 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:08.790025    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 19:38:09.212062 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:09.212027    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:38:09.789323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:09.789287    2562 patch_prober.go:28] interesting pod/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 19:38:09.789745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:09.789363    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 19:38:10.789219 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:10.789175    2562 patch_prober.go:28] interesting pod/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 19:38:10.789402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:10.789249    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 19:38:11.789175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:11.789142    2562 patch_prober.go:28] interesting pod/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 19:38:11.789359 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:11.789208    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 19:38:12.789166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:12.789128    2562 patch_prober.go:28] interesting pod/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 11 19:38:12.789618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:12.789183    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 11 19:38:13.116885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:13.116847    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:38:13.968953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:13.968911    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:38:13.970688 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:13.970659    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:38:25.490090 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:25.490054    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:38:30.903568 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:30.903516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:38:40.511632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.511592    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" podUID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" containerName="main" containerID="cri-o://0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8" gracePeriod=45
Sep 11 19:38:40.764482 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.764415    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:38:40.884193 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884157    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884393 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884205    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqtxw\" (UniqueName: \"kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884393 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884341    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884393 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884369    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884604 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884420    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884604 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884450    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm\") pod \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\" (UID: \"6d6a230d-63fa-4201-9d18-0eb4cabe5f86\") "
Sep 11 19:38:40.884708 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:38:40.884759 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884671    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache" (OuterVolumeSpecName: "model-cache") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:38:40.884813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884755    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home" (OuterVolumeSpecName: "home") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:38:40.884895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884871    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tmp-dir\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:40.884895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884891    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-model-cache\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:40.884895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.884900    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-home\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:40.886541 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.886502    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm" (OuterVolumeSpecName: "dshm") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:38:40.886661 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.886577    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw" (OuterVolumeSpecName: "kube-api-access-jqtxw") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "kube-api-access-jqtxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:38:40.886661 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.886578    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6d6a230d-63fa-4201-9d18-0eb4cabe5f86" (UID: "6d6a230d-63fa-4201-9d18-0eb4cabe5f86"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:38:40.985762 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.985726    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-tls-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:40.985762 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.985755    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqtxw\" (UniqueName: \"kubernetes.io/projected/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-kube-api-access-jqtxw\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:40.985762 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:40.985767    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6d6a230d-63fa-4201-9d18-0eb4cabe5f86-dshm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:38:41.458345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.458311    2562 generic.go:356] "Generic (PLEG): container finished" podID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" containerID="0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8" exitCode=0
Sep 11 19:38:41.458573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.458362    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"
Sep 11 19:38:41.458573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.458395    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" event={"ID":"6d6a230d-63fa-4201-9d18-0eb4cabe5f86","Type":"ContainerDied","Data":"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"}
Sep 11 19:38:41.458573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.458439    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp" event={"ID":"6d6a230d-63fa-4201-9d18-0eb4cabe5f86","Type":"ContainerDied","Data":"13236d8bb4ea5a378ec47b1d5b316053027add5e8c6a4c5c73524c95cdfdebad"}
Sep 11 19:38:41.458573 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.458456    2562 scope.go:117] "RemoveContainer" containerID="0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"
Sep 11 19:38:41.467867 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.467849    2562 scope.go:117] "RemoveContainer" containerID="0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"
Sep 11 19:38:41.468126 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:38:41.468107    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8\": container with ID starting with 0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8 not found: ID does not exist" containerID="0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"
Sep 11 19:38:41.468172 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.468134    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8"} err="failed to get container status \"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8\": rpc error: code = NotFound desc = could not find container \"0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8\": container with ID starting with 0c9d5a9725594786df71904328bf716f0fea0eab2202122cbc5dd55030d84dd8 not found: ID does not exist"
Sep 11 19:38:41.479793 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.479767    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:38:41.486015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.485992    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-a0610b/test-model-a0610b-kserve-77d567847c-n4pfp"]
Sep 11 19:38:41.979448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:41.979410    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" path="/var/lib/kubelet/pods/6d6a230d-63fa-4201-9d18-0eb4cabe5f86/volumes"
Sep 11 19:38:53.611386 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:38:53.611308    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:39:19.505518 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:19.505481    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:39:24.180079 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.180043    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:39:24.180848 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.180809    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" podUID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" containerName="maas-api" containerID="cri-o://a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff" gracePeriod=30
Sep 11 19:39:24.431331 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.431264    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:39:24.510988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.510951    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gsws5\" (UniqueName: \"kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5\") pod \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") "
Sep 11 19:39:24.511199 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.511038    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") pod \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") "
Sep 11 19:39:24.511199 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.511059    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs\") pod \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") "
Sep 11 19:39:24.511199 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.511129    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca\") pod \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\" (UID: \"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705\") "
Sep 11 19:39:24.511612 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.511534    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" (UID: "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:24.513097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.513070    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5" (OuterVolumeSpecName: "kube-api-access-gsws5") pod "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" (UID: "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705"). InnerVolumeSpecName "kube-api-access-gsws5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:24.513212 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.513196    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" (UID: "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:39:24.513295 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.513275    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" (UID: "06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:39:24.611879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.611836    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:24.611879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.611869    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:24.611879 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.611882    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:24.612125 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.611893    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gsws5\" (UniqueName: \"kubernetes.io/projected/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705-kube-api-access-gsws5\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:24.692380 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.692288    2562 generic.go:356] "Generic (PLEG): container finished" podID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" containerID="a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff" exitCode=0
Sep 11 19:39:24.692380 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.692331    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"
Sep 11 19:39:24.692380 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.692336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" event={"ID":"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705","Type":"ContainerDied","Data":"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"}
Sep 11 19:39:24.692719 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.692388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z" event={"ID":"06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705","Type":"ContainerDied","Data":"f9f49a9745d30fa7787e0b4d66a3505d35ed9dc2d8fad10183054fd8297aeaf0"}
Sep 11 19:39:24.692719 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.692416    2562 scope.go:117] "RemoveContainer" containerID="a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"
Sep 11 19:39:24.701706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.701687    2562 scope.go:117] "RemoveContainer" containerID="a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"
Sep 11 19:39:24.701939 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:39:24.701919    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff\": container with ID starting with a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff not found: ID does not exist" containerID="a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"
Sep 11 19:39:24.702001 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.701953    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff"} err="failed to get container status \"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff\": rpc error: code = NotFound desc = could not find container \"a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff\": container with ID starting with a537ed99739251b1d2ad87a3b5243b2123f48de9abf0f14d40944b7f1afea6ff not found: ID does not exist"
Sep 11 19:39:24.713460 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.713425    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:39:24.716755 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:24.716733    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-515a4f-b964c8b6d-g9r9z"]
Sep 11 19:39:25.979028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:25.978993    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" path="/var/lib/kubelet/pods/06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705/volumes"
Sep 11 19:39:30.836843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:30.836810    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:39:30.837274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:30.837038    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" containerID="cri-o://cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40" gracePeriod=30
Sep 11 19:39:30.969439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:30.969400    2562 patch_prober.go:28] interesting pod/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:39:30.969630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:30.969476    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:39:31.651592 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.651539    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:39:31.652453 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.652427    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" containerName="main"
Sep 11 19:39:31.652612 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.652597    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" containerName="main"
Sep 11 19:39:31.652725 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.652712    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" containerName="maas-api"
Sep 11 19:39:31.652815 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.652804    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" containerName="maas-api"
Sep 11 19:39:31.653030 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.653015    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="06f13bd6-dfb6-4ac9-ab2d-3aaf7d4fc705" containerName="maas-api"
Sep 11 19:39:31.653146 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.653134    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6a230d-63fa-4201-9d18-0eb4cabe5f86" containerName="main"
Sep 11 19:39:31.656892 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.656867    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.659467 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.659445    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-19859a-openshift-default-dockercfg-xn7fl\""
Sep 11 19:39:31.668512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.668482    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:39:31.683371 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683386    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbl67\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683479    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683617    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683692 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683654    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683695    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.683841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.683726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785175    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785210 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785210    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785237    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785438 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785410    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785620 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785620 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785574    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbl67\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785620 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785613    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785641    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785658    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.785789 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.786021 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.785967    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.786128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.786101    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.786128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.786104    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.788070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.788046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.788168 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.788098    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.794406 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.794377    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbl67\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.794755 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.794734    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token\") pod \"e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") " pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:31.969796 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:31.969711    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:32.243930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.243897    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:39:32.246592 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:39:32.246524    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb4bfec5_e34b_4b07_a1a0_2d093b7b6275.slice/crio-36d8a31c1af2a2cfdbeb1f400c6521587c60e46e109562bbea3352a3a96aaa95 WatchSource:0}: Error finding container 36d8a31c1af2a2cfdbeb1f400c6521587c60e46e109562bbea3352a3a96aaa95: Status 404 returned error can't find the container with id 36d8a31c1af2a2cfdbeb1f400c6521587c60e46e109562bbea3352a3a96aaa95
Sep 11 19:39:32.249563 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.249501    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:32.249683 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.249613    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:32.249683 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.249663    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:32.747650 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.747609    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerStarted","Data":"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"}
Sep 11 19:39:32.747854 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.747668    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerStarted","Data":"36d8a31c1af2a2cfdbeb1f400c6521587c60e46e109562bbea3352a3a96aaa95"}
Sep 11 19:39:32.766541 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.766464    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podStartSLOduration=1.766445174 podStartE2EDuration="1.766445174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:39:32.766248486 +0000 UTC m=+1295.299304620" watchObservedRunningTime="2026-09-11 19:39:32.766445174 +0000 UTC m=+1295.299501295"
Sep 11 19:39:32.970655 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:32.970612    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:33.981469 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:33.981433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:34.759785 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:34.759757    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:34.760866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:34.760841    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:36.096131 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.096107    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:39:36.232513 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232419    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232513 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232468    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232513 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232495    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232625    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7sdl\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232664    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232731    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232763    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232805    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:36.232833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232819    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:36.233171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232877    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert\") pod \"663081de-a940-4d36-bd02-effda39fd370\" (UID: \"663081de-a940-4d36-bd02-effda39fd370\") "
Sep 11 19:39:36.233171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.232946    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:36.233171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233047    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data" (OuterVolumeSpecName: "istio-data") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:36.233346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233269    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.233346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233289    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.233346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233299    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.233346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233308    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.233346 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.233330    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:39:36.235070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.235043    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:39:36.235180 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.235078    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:39:36.235251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.235236    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token" (OuterVolumeSpecName: "istio-token") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:36.235317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.235303    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl" (OuterVolumeSpecName: "kube-api-access-k7sdl") pod "663081de-a940-4d36-bd02-effda39fd370" (UID: "663081de-a940-4d36-bd02-effda39fd370"). InnerVolumeSpecName "kube-api-access-k7sdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:39:36.333865 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.333833    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/663081de-a940-4d36-bd02-effda39fd370-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.333865 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.333863    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.334052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.333874    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7sdl\" (UniqueName: \"kubernetes.io/projected/663081de-a940-4d36-bd02-effda39fd370-kube-api-access-k7sdl\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.334052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.333885    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/663081de-a940-4d36-bd02-effda39fd370-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.334052 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.333893    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/663081de-a940-4d36-bd02-effda39fd370-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:39:36.771579 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.771525    2562 generic.go:356] "Generic (PLEG): container finished" podID="663081de-a940-4d36-bd02-effda39fd370" containerID="cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40" exitCode=0
Sep 11 19:39:36.771765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.771577    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerDied","Data":"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"}
Sep 11 19:39:36.771765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.771636    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm" event={"ID":"663081de-a940-4d36-bd02-effda39fd370","Type":"ContainerDied","Data":"9e5f875ffdbe8b86af97b57f7a9734a5751fbcd07ea67a4b6c9ba35359af038b"}
Sep 11 19:39:36.771765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.771586    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"
Sep 11 19:39:36.771765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.771668    2562 scope.go:117] "RemoveContainer" containerID="cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"
Sep 11 19:39:36.782102 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.782083    2562 scope.go:117] "RemoveContainer" containerID="eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"
Sep 11 19:39:36.789975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.789957    2562 scope.go:117] "RemoveContainer" containerID="cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"
Sep 11 19:39:36.790252 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:39:36.790233    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40\": container with ID starting with cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40 not found: ID does not exist" containerID="cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"
Sep 11 19:39:36.790294 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.790261    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40"} err="failed to get container status \"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40\": rpc error: code = NotFound desc = could not find container \"cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40\": container with ID starting with cef84c5cb037f18e276be4727c50690e6c91a335316c34594ff41a7da871ad40 not found: ID does not exist"
Sep 11 19:39:36.790294 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.790278    2562 scope.go:117] "RemoveContainer" containerID="eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"
Sep 11 19:39:36.790529 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:39:36.790505    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4\": container with ID starting with eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4 not found: ID does not exist" containerID="eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"
Sep 11 19:39:36.790658 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.790535    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4"} err="failed to get container status \"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4\": rpc error: code = NotFound desc = could not find container \"eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4\": container with ID starting with eef4c73cdf76e96d2c8b185ce4942b5862b0b1bf981847163a9014700ce168b4 not found: ID does not exist"
Sep 11 19:39:36.797460 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.797436    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:39:36.804201 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:36.804178    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-515a4f-openshift-default-757889cf48-g2znm"]
Sep 11 19:39:37.979192 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:37.979159    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="663081de-a940-4d36-bd02-effda39fd370" path="/var/lib/kubelet/pods/663081de-a940-4d36-bd02-effda39fd370/volumes"
Sep 11 19:39:38.123268 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123238    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:39:38.123850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123826    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.123850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123849    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.124028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123864    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.124028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123872    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.124028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123965    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.124028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.123980    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="663081de-a940-4d36-bd02-effda39fd370" containerName="istio-proxy"
Sep 11 19:39:38.129272 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.129250    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.131829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.131809    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-19859a-serving-cert\""
Sep 11 19:39:38.140276 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.140252    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:39:38.255336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.255240    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.255336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.255286    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.255336 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.255321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.255695 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.255447    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4glmr\" (UniqueName: \"kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.356476 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.356432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4glmr\" (UniqueName: \"kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.356739 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.356518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.356739 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.356560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.356739 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.356699    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.357173 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.357153    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.359081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.359052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.359081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.359074    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.364081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.364059    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4glmr\" (UniqueName: \"kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr\") pod \"maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.443642 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.443597    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:38.717792 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.717763    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:39:38.719900 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:39:38.719872    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65144a53_f0ba_4ffb_aaef_d1420003d6cf.slice/crio-e6eaa074e8901b4e6d2488d79312ccacab1e6e87f221d7a18ed7e38cf2f633b2 WatchSource:0}: Error finding container e6eaa074e8901b4e6d2488d79312ccacab1e6e87f221d7a18ed7e38cf2f633b2: Status 404 returned error can't find the container with id e6eaa074e8901b4e6d2488d79312ccacab1e6e87f221d7a18ed7e38cf2f633b2
Sep 11 19:39:38.783885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:38.783853    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" event={"ID":"65144a53-f0ba-4ffb-aaef-d1420003d6cf","Type":"ContainerStarted","Data":"e6eaa074e8901b4e6d2488d79312ccacab1e6e87f221d7a18ed7e38cf2f633b2"}
Sep 11 19:39:39.790515 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:39.790483    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" event={"ID":"65144a53-f0ba-4ffb-aaef-d1420003d6cf","Type":"ContainerStarted","Data":"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"}
Sep 11 19:39:39.790916 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:39.790621    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:39.809130 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:39.809081    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" podStartSLOduration=1.419307815 podStartE2EDuration="1.809065502s" totalImagesPullingTime="389.757687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:39:39.807093067 +0000 UTC m=+1302.340149202" watchObservedRunningTime="2026-09-11 19:39:39.809065502 +0000 UTC m=+1302.342121624"
Sep 11 19:39:45.802011 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:45.801979    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:39:46.211390 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:46.211354    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:39:56.898067 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.898024    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerID="733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c" exitCode=0
Sep 11 19:39:56.898633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.898095    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerDied","Data":"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"}
Sep 11 19:39:56.898711 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.898664    2562 scope.go:117] "RemoveContainer" containerID="733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"
Sep 11 19:39:56.900012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.899978    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:56.900099 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.900057    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:56.900099 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:56.900091    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:39:57.907528 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:57.907495    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerStarted","Data":"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"}
Sep 11 19:39:57.970732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:57.970694    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:39:57.971033 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:57.970928    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 19:39:57.971219 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:57.971194    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 19:39:58.970220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:58.970184    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 19:39:58.972638 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:58.970813    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 19:39:59.970839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:59.970359    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 19:39:59.970839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:39:59.970422    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 19:40:00.970382 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:00.970342    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 19:40:00.970699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:00.970665    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 19:40:01.970783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:01.970743    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 11 19:40:01.971388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:01.971352    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 11 19:40:02.983753 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:02.983718    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:40:02.984276 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:02.984150    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:40:02.984944 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:02.984922    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:40:11.399354 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:11.399321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:40:33.504017 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:33.503938    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:40:53.316997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:53.316960    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:40:53.317465 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:53.317232    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy" containerID="cri-o://e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0" gracePeriod=30
Sep 11 19:40:55.919779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:55.919741    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:40:58.573471 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.573440    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:40:58.662080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.661999    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662048    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662076    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662158    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662187    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662222    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662266    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662315    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:58.662340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662336    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:58.662784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662351    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzk8c\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c\") pod \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\" (UID: \"b8f31393-b88c-466c-9f3d-5c1716d1d43b\") "
Sep 11 19:40:58.662784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662430    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:58.662784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662532    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:58.662944 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662861    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.662944 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662881    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.662944 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662895    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.662944 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.662911    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.663240 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.663214    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:40:58.664452 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.664424    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:40:58.664651 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.664622    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:40:58.664772 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.664702    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c" (OuterVolumeSpecName: "kube-api-access-bzk8c") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "kube-api-access-bzk8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:58.665071 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.665048    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8f31393-b88c-466c-9f3d-5c1716d1d43b" (UID: "b8f31393-b88c-466c-9f3d-5c1716d1d43b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:40:58.763979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.763946    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.763979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.763974    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.763979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.763985    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.764236 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.763994    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzk8c\" (UniqueName: \"kubernetes.io/projected/b8f31393-b88c-466c-9f3d-5c1716d1d43b-kube-api-access-bzk8c\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:58.764236 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:58.764004    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8f31393-b88c-466c-9f3d-5c1716d1d43b-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:40:59.249706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.249667    2562 generic.go:356] "Generic (PLEG): container finished" podID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerID="e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0" exitCode=0
Sep 11 19:40:59.249915 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.249725    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"
Sep 11 19:40:59.249915 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.249754    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerDied","Data":"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"}
Sep 11 19:40:59.249915 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.249824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt" event={"ID":"b8f31393-b88c-466c-9f3d-5c1716d1d43b","Type":"ContainerDied","Data":"97e5401a9b07a3550045f71c6ab9e9ff75074663e465d67340508ee6007aba61"}
Sep 11 19:40:59.249915 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.249854    2562 scope.go:117] "RemoveContainer" containerID="e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"
Sep 11 19:40:59.259930 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.259910    2562 scope.go:117] "RemoveContainer" containerID="6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"
Sep 11 19:40:59.268496 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.268473    2562 scope.go:117] "RemoveContainer" containerID="e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"
Sep 11 19:40:59.268836 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:40:59.268810    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0\": container with ID starting with e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0 not found: ID does not exist" containerID="e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"
Sep 11 19:40:59.268943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.268848    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0"} err="failed to get container status \"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0\": rpc error: code = NotFound desc = could not find container \"e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0\": container with ID starting with e30529f178a3240d14525c63df9779c9a452a469db52dc853d1f8ca56395e6d0 not found: ID does not exist"
Sep 11 19:40:59.268943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.268873    2562 scope.go:117] "RemoveContainer" containerID="6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"
Sep 11 19:40:59.269275 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:40:59.269216    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f\": container with ID starting with 6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f not found: ID does not exist" containerID="6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"
Sep 11 19:40:59.269275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.269251    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f"} err="failed to get container status \"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f\": rpc error: code = NotFound desc = could not find container \"6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f\": container with ID starting with 6b1c78c76a08958ac45de4d5fae5c1fee281cff3b2efaee8bcf2205cfacd1e1f not found: ID does not exist"
Sep 11 19:40:59.271310 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.271291    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:40:59.274604 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.274579    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-55586842-openshift-default-88d5b9c84-xtmmt"]
Sep 11 19:40:59.979629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:40:59.979595    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" path="/var/lib/kubelet/pods/b8f31393-b88c-466c-9f3d-5c1716d1d43b/volumes"
Sep 11 19:41:13.702365 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:13.702332    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:41:30.708301 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:30.708260    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:41:47.254623 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.254590    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:41:47.255223 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.255202    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:47.255320 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.255225    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:47.255376 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.255350    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:47.258715 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.258691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.261317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.261290    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-bed9fb-openshift-default-dockercfg-f44kk\""
Sep 11 19:41:47.271841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.271813    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:41:47.436582 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436628    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436689    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436768 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436838    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5jrd\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.436924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436878    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.437037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.436924    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538499 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538501    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538518    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538538    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.538822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538890    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538935    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538947    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5jrd\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.538990    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.539026    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.539052    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.539859 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.539834    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.541073 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.541046    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.541183 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.541107    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.547967 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.547942    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.548106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.548071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5jrd\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd\") pod \"e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") " pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.570951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.570921    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:47.845392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.845367    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:41:47.847440 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:41:47.847404    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeab0c536_bf9e_4332_9fb8_265ce522a569.slice/crio-f001533d401bb1adc5a7c229a6cd6b36c9cdd9926c2950b70e54edd7e5dc5570 WatchSource:0}: Error finding container f001533d401bb1adc5a7c229a6cd6b36c9cdd9926c2950b70e54edd7e5dc5570: Status 404 returned error can't find the container with id f001533d401bb1adc5a7c229a6cd6b36c9cdd9926c2950b70e54edd7e5dc5570
Sep 11 19:41:47.850299 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.850262    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:41:47.850370 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.850341    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:41:47.850409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:47.850383    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:41:48.509754 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.509717    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerStarted","Data":"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"}
Sep 11 19:41:48.510146 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.509785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerStarted","Data":"f001533d401bb1adc5a7c229a6cd6b36c9cdd9926c2950b70e54edd7e5dc5570"}
Sep 11 19:41:48.530441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.530390    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podStartSLOduration=1.530374516 podStartE2EDuration="1.530374516s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:48.52944234 +0000 UTC m=+1431.062498464" watchObservedRunningTime="2026-09-11 19:41:48.530374516 +0000 UTC m=+1431.063430634"
Sep 11 19:41:48.571767 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.571734    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:48.573422 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.573398    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:41:48.573529 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:48.573450    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:41:49.575973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:49.575940    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:50.520401 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:50.520358    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:50.521310 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:50.521288    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:41:53.101108 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:53.101066    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:41:54.305311 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.305275    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:41:54.305833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.305720    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:54.305833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.305732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:54.305833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.305809    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8f31393-b88c-466c-9f3d-5c1716d1d43b" containerName="istio-proxy"
Sep 11 19:41:54.309306 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.309283    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.311629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.311603    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-bed9fb-serving-cert\""
Sep 11 19:41:54.321662 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.321634    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:41:54.405136 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.405092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.405334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.405143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.405334 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.405194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.405453 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.405366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lw5kr\" (UniqueName: \"kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.506231 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.506181    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lw5kr\" (UniqueName: \"kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.506447 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.506245    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.506447 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.506274    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.506447 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.506312    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.506708 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:41:54.506450    2562 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-serving-cert: secret "maas-api-e2e-api-a-bed9fb-serving-cert" not found
Sep 11 19:41:54.506708 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:41:54.506521    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls podName:c1efec23-b2a8-45a5-976f-9547cd81b72c nodeName:}" failed. No retries permitted until 2026-09-11 19:41:55.006502061 +0000 UTC m=+1437.539558161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls") pod "maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" (UID: "c1efec23-b2a8-45a5-976f-9547cd81b72c") : secret "maas-api-e2e-api-a-bed9fb-serving-cert" not found
Sep 11 19:41:54.507115 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.507071    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.509041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.509016    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:54.514665 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:54.514643    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lw5kr\" (UniqueName: \"kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:55.011398 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.011355    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:55.013955 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.013924    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") pod \"maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:55.224507 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.224469    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:55.499814 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.499782    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:41:55.501250 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:41:55.501222    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1efec23_b2a8_45a5_976f_9547cd81b72c.slice/crio-86e5b0615f80af57bc0eb16cc8a4dc9e7a166a25f3ccd17e8a07d1c2116cabb4 WatchSource:0}: Error finding container 86e5b0615f80af57bc0eb16cc8a4dc9e7a166a25f3ccd17e8a07d1c2116cabb4: Status 404 returned error can't find the container with id 86e5b0615f80af57bc0eb16cc8a4dc9e7a166a25f3ccd17e8a07d1c2116cabb4
Sep 11 19:41:55.502524 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.502507    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:41:55.550257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:55.550174    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" event={"ID":"c1efec23-b2a8-45a5-976f-9547cd81b72c","Type":"ContainerStarted","Data":"86e5b0615f80af57bc0eb16cc8a4dc9e7a166a25f3ccd17e8a07d1c2116cabb4"}
Sep 11 19:41:56.557379 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:56.557329    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" event={"ID":"c1efec23-b2a8-45a5-976f-9547cd81b72c","Type":"ContainerStarted","Data":"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"}
Sep 11 19:41:56.557761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:56.557411    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:41:56.580277 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:41:56.580223    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" podStartSLOduration=2.225761997 podStartE2EDuration="2.580205645s" totalImagesPullingTime="354.443648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:41:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:41:56.579282093 +0000 UTC m=+1439.112338215" watchObservedRunningTime="2026-09-11 19:41:56.580205645 +0000 UTC m=+1439.113261766"
Sep 11 19:42:02.568926 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:02.568896    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:42:20.522412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.522370    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:20.522838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.522444    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:20.712383 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.712349    2562 generic.go:356] "Generic (PLEG): container finished" podID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerID="2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c" exitCode=0
Sep 11 19:42:20.712557 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.712426    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerDied","Data":"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"}
Sep 11 19:42:20.712887 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.712872    2562 scope.go:117] "RemoveContainer" containerID="2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"
Sep 11 19:42:20.714107 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.714073    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:20.714183 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.714165    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:20.714235 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:20.714219    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:21.342997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.342956    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:42:21.348183 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.348157    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.351458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.351407    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-491be8-openshift-default-dockercfg-ffhnl\""
Sep 11 19:42:21.359099 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.359076    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:42:21.486134 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486090    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486326 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486213    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486326 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486253    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486326 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486350    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486389    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486431    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486501 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486458    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.486686 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.486516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhpgl\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587345    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhpgl\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587389 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587392    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587441    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587624    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587665    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587724    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587879    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.587924 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.587901    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.588353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.588094    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.588353 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.588212    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.588458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.588360    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.588869 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.588846    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.589908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.589880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.590133 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.590116    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.595901 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.595837    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.596041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.596024    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhpgl\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl\") pod \"e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") " pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.663855 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.663824    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:21.726453 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.722343    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerStarted","Data":"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"}
Sep 11 19:42:21.941643 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.941615    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:42:21.942892 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:42:21.942864    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4733a67e_9b6e_4bc9_831a_5edc920270d5.slice/crio-1516474782e14cbf809818189f4576f520c1d3dcbb779f69db66282f50ffab50 WatchSource:0}: Error finding container 1516474782e14cbf809818189f4576f520c1d3dcbb779f69db66282f50ffab50: Status 404 returned error can't find the container with id 1516474782e14cbf809818189f4576f520c1d3dcbb779f69db66282f50ffab50
Sep 11 19:42:21.945817 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.945709    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:21.945937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.945821    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:21.945937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:21.945876    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:22.320220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.320144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:42:22.571703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.571605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:42:22.571873 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.571750    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:22.571873 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.571795    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:22.729105 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.729061    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerStarted","Data":"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"}
Sep 11 19:42:22.729487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.729118    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerStarted","Data":"1516474782e14cbf809818189f4576f520c1d3dcbb779f69db66282f50ffab50"}
Sep 11 19:42:22.752925 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:22.752859    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podStartSLOduration=1.752836801 podStartE2EDuration="1.752836801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:42:22.749311989 +0000 UTC m=+1465.282368148" watchObservedRunningTime="2026-09-11 19:42:22.752836801 +0000 UTC m=+1465.285892925"
Sep 11 19:42:23.571731 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.571690    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:23.572024 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.571991    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:23.664676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.664640    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:23.681256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.681199    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:23.734519 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.734487    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:23.735747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:23.735721    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:24.571811 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:24.571770    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:24.572043 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:24.571876    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:25.572388 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:25.572346    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:25.572897 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:25.572635    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:26.571813 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:26.571767    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 11 19:42:26.572015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:26.571851    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 11 19:42:27.670698 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:27.670653    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:42:27.671428 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:27.671400    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:42:27.672424 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:27.672403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:42:51.909127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.909093    2562 generic.go:356] "Generic (PLEG): container finished" podID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerID="a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01" exitCode=0
Sep 11 19:42:51.909669 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.909172    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerDied","Data":"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"}
Sep 11 19:42:51.909782 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.909764    2562 scope.go:117] "RemoveContainer" containerID="a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"
Sep 11 19:42:51.910925 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.910898    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:51.910991 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.910968    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:51.911028 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:51.910999    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:42:52.917130 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:52.917098    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerStarted","Data":"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"}
Sep 11 19:42:53.664590 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:53.664537    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:53.665994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:53.665963    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:53.666203 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:53.666176    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:53.734653 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:53.734621    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:53.908832 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:53.908799    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:42:54.665321 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:54.665277    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:54.665822 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:54.665359    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:55.665038 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:55.664998    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:55.665364 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:55.665324    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:56.664466 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:56.664415    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:56.664701 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:56.664496    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:57.664946 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:57.664909    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:57.665521 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:57.665487    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:58.030281 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:58.030202    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:42:58.033857 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:58.033831    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:42:58.665139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:58.665103    2562 patch_prober.go:28] interesting pod/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 11 19:42:58.665566 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:58.665159    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 11 19:42:59.668783 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:59.668749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:42:59.669836 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:42:59.669816    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:43:02.998133 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:02.998097    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:43:02.998615 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:02.998360    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" podUID="c1efec23-b2a8-45a5-976f-9547cd81b72c" containerName="maas-api" containerID="cri-o://cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06" gracePeriod=30
Sep 11 19:43:03.257633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.257563    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:43:03.342850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.342816    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs\") pod \"c1efec23-b2a8-45a5-976f-9547cd81b72c\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") "
Sep 11 19:43:03.343049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.342866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca\") pod \"c1efec23-b2a8-45a5-976f-9547cd81b72c\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") "
Sep 11 19:43:03.343049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.342995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lw5kr\" (UniqueName: \"kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr\") pod \"c1efec23-b2a8-45a5-976f-9547cd81b72c\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") "
Sep 11 19:43:03.343049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.343032    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") pod \"c1efec23-b2a8-45a5-976f-9547cd81b72c\" (UID: \"c1efec23-b2a8-45a5-976f-9547cd81b72c\") "
Sep 11 19:43:03.343227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.343201    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1efec23-b2a8-45a5-976f-9547cd81b72c" (UID: "c1efec23-b2a8-45a5-976f-9547cd81b72c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:03.343444 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.343419    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1efec23-b2a8-45a5-976f-9547cd81b72c-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.345087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.345044    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1efec23-b2a8-45a5-976f-9547cd81b72c" (UID: "c1efec23-b2a8-45a5-976f-9547cd81b72c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:43:03.345087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.345056    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr" (OuterVolumeSpecName: "kube-api-access-lw5kr") pod "c1efec23-b2a8-45a5-976f-9547cd81b72c" (UID: "c1efec23-b2a8-45a5-976f-9547cd81b72c"). InnerVolumeSpecName "kube-api-access-lw5kr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:03.345221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.345098    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c1efec23-b2a8-45a5-976f-9547cd81b72c" (UID: "c1efec23-b2a8-45a5-976f-9547cd81b72c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:43:03.444763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.444730    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lw5kr\" (UniqueName: \"kubernetes.io/projected/c1efec23-b2a8-45a5-976f-9547cd81b72c-kube-api-access-lw5kr\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.444763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.444761    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.444763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.444771    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1efec23-b2a8-45a5-976f-9547cd81b72c-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:03.985040 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.985003    2562 generic.go:356] "Generic (PLEG): container finished" podID="c1efec23-b2a8-45a5-976f-9547cd81b72c" containerID="cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06" exitCode=0
Sep 11 19:43:03.985228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.985056    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"
Sep 11 19:43:03.985228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.985084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" event={"ID":"c1efec23-b2a8-45a5-976f-9547cd81b72c","Type":"ContainerDied","Data":"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"}
Sep 11 19:43:03.985228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.985140    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d" event={"ID":"c1efec23-b2a8-45a5-976f-9547cd81b72c","Type":"ContainerDied","Data":"86e5b0615f80af57bc0eb16cc8a4dc9e7a166a25f3ccd17e8a07d1c2116cabb4"}
Sep 11 19:43:03.985228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.985156    2562 scope.go:117] "RemoveContainer" containerID="cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"
Sep 11 19:43:03.995382 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.995363    2562 scope.go:117] "RemoveContainer" containerID="cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"
Sep 11 19:43:03.995658 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:03.995641    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06\": container with ID starting with cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06 not found: ID does not exist" containerID="cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"
Sep 11 19:43:03.995733 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:03.995667    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06"} err="failed to get container status \"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06\": rpc error: code = NotFound desc = could not find container \"cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06\": container with ID starting with cd8448fbf333ddf9a391ed392b8d8a14860ed0783227e30fad0fc6048c9f9b06 not found: ID does not exist"
Sep 11 19:43:04.009690 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:04.009664    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:43:04.013870 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:04.013848    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-bed9fb-86dc96bcd-bkw7d"]
Sep 11 19:43:05.980000 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:05.979969    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1efec23-b2a8-45a5-976f-9547cd81b72c" path="/var/lib/kubelet/pods/c1efec23-b2a8-45a5-976f-9547cd81b72c/volumes"
Sep 11 19:43:09.746658 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:09.746621    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:43:09.747241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:09.746896    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" containerID="cri-o://fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019" gracePeriod=30
Sep 11 19:43:12.673689 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:12.673648    2562 patch_prober.go:28] interesting pod/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:43:12.674126 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:12.673710    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:43:15.003407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.003381    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:43:15.050694 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.050602    2562 generic.go:356] "Generic (PLEG): container finished" podID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerID="fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019" exitCode=0
Sep 11 19:43:15.050694 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.050652    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"
Sep 11 19:43:15.050694 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.050679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerDied","Data":"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"}
Sep 11 19:43:15.050955 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.050739    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj" event={"ID":"eab0c536-bf9e-4332-9fb8-265ce522a569","Type":"ContainerDied","Data":"f001533d401bb1adc5a7c229a6cd6b36c9cdd9926c2950b70e54edd7e5dc5570"}
Sep 11 19:43:15.050955 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.050760    2562 scope.go:117] "RemoveContainer" containerID="fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"
Sep 11 19:43:15.060636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.060778 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.060778 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060745    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.060896 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060783    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.060896 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060828    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.060896 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060852    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.061046 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060904    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.061046 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060931    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.061046 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060953    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data" (OuterVolumeSpecName: "istio-data") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:15.061046 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.060995    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t5jrd\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd\") pod \"eab0c536-bf9e-4332-9fb8-265ce522a569\" (UID: \"eab0c536-bf9e-4332-9fb8-265ce522a569\") "
Sep 11 19:43:15.061241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061060    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:15.061241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061073    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:15.061241 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061083    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:15.061391 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061276    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:15.061506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061405    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.061506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061430    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eab0c536-bf9e-4332-9fb8-265ce522a569-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.061506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061443    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.061506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061456    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.061506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.061469    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.063703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.063677    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:15.063833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.063676    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:43:15.063833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.063760    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token" (OuterVolumeSpecName: "istio-token") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:15.063953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.063855    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd" (OuterVolumeSpecName: "kube-api-access-t5jrd") pod "eab0c536-bf9e-4332-9fb8-265ce522a569" (UID: "eab0c536-bf9e-4332-9fb8-265ce522a569"). InnerVolumeSpecName "kube-api-access-t5jrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:15.064291 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.064274    2562 scope.go:117] "RemoveContainer" containerID="2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"
Sep 11 19:43:15.084936 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.084914    2562 scope.go:117] "RemoveContainer" containerID="fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"
Sep 11 19:43:15.085241 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:15.085222    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019\": container with ID starting with fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019 not found: ID does not exist" containerID="fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"
Sep 11 19:43:15.085335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.085261    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019"} err="failed to get container status \"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019\": rpc error: code = NotFound desc = could not find container \"fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019\": container with ID starting with fe3cb31dec684b2370af727a771598503eed2df151174a6e4e95291a063a3019 not found: ID does not exist"
Sep 11 19:43:15.085335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.085281    2562 scope.go:117] "RemoveContainer" containerID="2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"
Sep 11 19:43:15.085522 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:15.085501    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c\": container with ID starting with 2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c not found: ID does not exist" containerID="2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"
Sep 11 19:43:15.085591 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.085530    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c"} err="failed to get container status \"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c\": rpc error: code = NotFound desc = could not find container \"2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c\": container with ID starting with 2f6726dccb1c92fab78b6d1f2dfadb2c6649add92eb8d51b457c8ab2f155959c not found: ID does not exist"
Sep 11 19:43:15.162311 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.162284    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.162311 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.162311    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.162504 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.162319    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eab0c536-bf9e-4332-9fb8-265ce522a569-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.162504 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.162327    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5jrd\" (UniqueName: \"kubernetes.io/projected/eab0c536-bf9e-4332-9fb8-265ce522a569-kube-api-access-t5jrd\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:15.372918 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.372891    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:43:15.377307 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.377282    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-bed9fb-openshift-default-6967b44cb-rwtbj"]
Sep 11 19:43:15.979374 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:15.979337    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" path="/var/lib/kubelet/pods/eab0c536-bf9e-4332-9fb8-265ce522a569/volumes"
Sep 11 19:43:17.302602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:17.302560    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:43:32.685827 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:32.685732    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:43:32.686243 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:32.685984    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy" containerID="cri-o://72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4" gracePeriod=30
Sep 11 19:43:33.504375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:33.504338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:43:37.946427 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.946396    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:43:37.990853 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.990853 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990820    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.990853 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990843    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990876    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990906    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990924    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990944    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.990985    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhpgl\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991047    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs\") pod \"4733a67e-9b6e-4bc9-831a-5edc920270d5\" (UID: \"4733a67e-9b6e-4bc9-831a-5edc920270d5\") "
Sep 11 19:43:37.991127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:37.991487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991248    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:37.991487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991340    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:37.991487 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991454    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:37.991676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991535    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:37.991676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991539    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:37.991676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991576    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:37.991676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991591    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:37.991676 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.991603    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:37.993280 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.993255    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:37.993445 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.993419    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl" (OuterVolumeSpecName: "kube-api-access-zhpgl") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "kube-api-access-zhpgl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:37.993600 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.993580    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:43:37.993871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:37.993849    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4733a67e-9b6e-4bc9-831a-5edc920270d5" (UID: "4733a67e-9b6e-4bc9-831a-5edc920270d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:38.092128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.092090    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:38.092128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.092122    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:38.092128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.092132    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4733a67e-9b6e-4bc9-831a-5edc920270d5-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:38.092375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.092142    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4733a67e-9b6e-4bc9-831a-5edc920270d5-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:38.092375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.092156    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhpgl\" (UniqueName: \"kubernetes.io/projected/4733a67e-9b6e-4bc9-831a-5edc920270d5-kube-api-access-zhpgl\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:38.177741 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.177708    2562 generic.go:356] "Generic (PLEG): container finished" podID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerID="72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4" exitCode=0
Sep 11 19:43:38.177913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.177777    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"
Sep 11 19:43:38.177913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.177794    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerDied","Data":"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"}
Sep 11 19:43:38.177913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.177851    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4" event={"ID":"4733a67e-9b6e-4bc9-831a-5edc920270d5","Type":"ContainerDied","Data":"1516474782e14cbf809818189f4576f520c1d3dcbb779f69db66282f50ffab50"}
Sep 11 19:43:38.177913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.177874    2562 scope.go:117] "RemoveContainer" containerID="72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"
Sep 11 19:43:38.187500 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.187482    2562 scope.go:117] "RemoveContainer" containerID="a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"
Sep 11 19:43:38.195631 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.195615    2562 scope.go:117] "RemoveContainer" containerID="72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"
Sep 11 19:43:38.195932 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:38.195909    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4\": container with ID starting with 72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4 not found: ID does not exist" containerID="72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"
Sep 11 19:43:38.195997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.195945    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4"} err="failed to get container status \"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4\": rpc error: code = NotFound desc = could not find container \"72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4\": container with ID starting with 72486d6c04ad5c42b604aac43bb532b12a4bfc2aa892777df7fef15fa3d695b4 not found: ID does not exist"
Sep 11 19:43:38.195997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.195968    2562 scope.go:117] "RemoveContainer" containerID="a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"
Sep 11 19:43:38.196261 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:38.196242    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01\": container with ID starting with a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01 not found: ID does not exist" containerID="a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"
Sep 11 19:43:38.196311 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.196270    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01"} err="failed to get container status \"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01\": rpc error: code = NotFound desc = could not find container \"a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01\": container with ID starting with a81fccee452b5984b762ba8b3d45768094ead72df4bf18f3d8ff20debef2ad01 not found: ID does not exist"
Sep 11 19:43:38.202670 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.202647    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:43:38.205900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:38.205879    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-491be8-openshift-default-895f8f9d4-2sdq4"]
Sep 11 19:43:39.980385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:39.980339    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" path="/var/lib/kubelet/pods/4733a67e-9b6e-4bc9-831a-5edc920270d5/volumes"
Sep 11 19:43:50.222375 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:50.222339    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:43:50.222966 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:50.222632    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy" containerID="cri-o://4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1" gracePeriod=30
Sep 11 19:43:50.511027 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:50.510936    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:43:55.480779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.480753    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:43:55.563656 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563568    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563656 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563631    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563656 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563656    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563686    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563721    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563777    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563800    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f8npz\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563836    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.563943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563878    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:55.564239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563955    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs\") pod \"c621e364-7038-41f5-9ce9-34196ef152e3\" (UID: \"c621e364-7038-41f5-9ce9-34196ef152e3\") "
Sep 11 19:43:55.564239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.563981    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:55.564239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564076    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data" (OuterVolumeSpecName: "istio-data") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:55.564239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564135    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:43:55.564477 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564439    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:55.564540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564484    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.564540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564501    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.564540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564514    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c621e364-7038-41f5-9ce9-34196ef152e3-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.564540 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.564527    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.566147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.566121    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz" (OuterVolumeSpecName: "kube-api-access-f8npz") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "kube-api-access-f8npz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:55.566147 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.566137    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:43:55.566269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.566249    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token" (OuterVolumeSpecName: "istio-token") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:43:55.566317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.566302    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c621e364-7038-41f5-9ce9-34196ef152e3" (UID: "c621e364-7038-41f5-9ce9-34196ef152e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:43:55.665177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.665140    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c621e364-7038-41f5-9ce9-34196ef152e3-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.665177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.665178    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.665407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.665192    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8npz\" (UniqueName: \"kubernetes.io/projected/c621e364-7038-41f5-9ce9-34196ef152e3-kube-api-access-f8npz\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.665407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.665207    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:55.665407 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:55.665221    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c621e364-7038-41f5-9ce9-34196ef152e3-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:43:56.277518 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.277426    2562 generic.go:356] "Generic (PLEG): container finished" podID="c621e364-7038-41f5-9ce9-34196ef152e3" containerID="4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1" exitCode=0
Sep 11 19:43:56.277518 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.277490    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"
Sep 11 19:43:56.277728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.277514    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerDied","Data":"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"}
Sep 11 19:43:56.277728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.277597    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv" event={"ID":"c621e364-7038-41f5-9ce9-34196ef152e3","Type":"ContainerDied","Data":"e76376be37ffd35ed110e2048dd28998addb81e392f646b605a5e4b350a408af"}
Sep 11 19:43:56.277728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.277623    2562 scope.go:117] "RemoveContainer" containerID="4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"
Sep 11 19:43:56.286823 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.286799    2562 scope.go:117] "RemoveContainer" containerID="f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"
Sep 11 19:43:56.294936 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.294912    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:43:56.295765 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.295748    2562 scope.go:117] "RemoveContainer" containerID="4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"
Sep 11 19:43:56.296083 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:56.296058    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1\": container with ID starting with 4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1 not found: ID does not exist" containerID="4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"
Sep 11 19:43:56.296213 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.296100    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1"} err="failed to get container status \"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1\": rpc error: code = NotFound desc = could not find container \"4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1\": container with ID starting with 4dac5c2be65a329d5255f0d906ac02d3ddeb31ffa52f052c6e389a332ea620a1 not found: ID does not exist"
Sep 11 19:43:56.296213 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.296124    2562 scope.go:117] "RemoveContainer" containerID="f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"
Sep 11 19:43:56.297431 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:43:56.297398    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11\": container with ID starting with f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11 not found: ID does not exist" containerID="f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"
Sep 11 19:43:56.297595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.297440    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11"} err="failed to get container status \"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11\": rpc error: code = NotFound desc = could not find container \"f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11\": container with ID starting with f536be209d77b997425477ed2cda3ae6f085967402b0c92f171a6488c4f61b11 not found: ID does not exist"
Sep 11 19:43:56.299517 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:56.299498    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-b5bf35-openshift-default-fd5cc7544-gblbv"]
Sep 11 19:43:57.982752 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:43:57.981146    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" path="/var/lib/kubelet/pods/c621e364-7038-41f5-9ce9-34196ef152e3/volumes"
Sep 11 19:44:00.203254 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:00.203216    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:44:01.057107 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.057067    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:44:01.057361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.057331    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" podUID="c46cd3fa-5992-447a-8e56-b8b648019f13" containerName="maas-api" containerID="cri-o://52a038a71639ee81180d7df548309ff9b11fc28d6cf7e29714a9134067d627e6" gracePeriod=30
Sep 11 19:44:01.304017 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.303987    2562 generic.go:356] "Generic (PLEG): container finished" podID="c46cd3fa-5992-447a-8e56-b8b648019f13" containerID="52a038a71639ee81180d7df548309ff9b11fc28d6cf7e29714a9134067d627e6" exitCode=0
Sep 11 19:44:01.304441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.304035    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" event={"ID":"c46cd3fa-5992-447a-8e56-b8b648019f13","Type":"ContainerDied","Data":"52a038a71639ee81180d7df548309ff9b11fc28d6cf7e29714a9134067d627e6"}
Sep 11 19:44:01.304441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.304072    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8" event={"ID":"c46cd3fa-5992-447a-8e56-b8b648019f13","Type":"ContainerDied","Data":"5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9"}
Sep 11 19:44:01.304441 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.304088    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5745504a054d7875bb29c4a59b1e058b48fc199c2e9a1d37cbe0533ad5dbbab9"
Sep 11 19:44:01.314409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.314356    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:44:01.418771 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.418737    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs\") pod \"c46cd3fa-5992-447a-8e56-b8b648019f13\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") "
Sep 11 19:44:01.418951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.418782    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca\") pod \"c46cd3fa-5992-447a-8e56-b8b648019f13\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") "
Sep 11 19:44:01.418951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.418862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82dfg\" (UniqueName: \"kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg\") pod \"c46cd3fa-5992-447a-8e56-b8b648019f13\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") "
Sep 11 19:44:01.418951 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.418908    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls\") pod \"c46cd3fa-5992-447a-8e56-b8b648019f13\" (UID: \"c46cd3fa-5992-447a-8e56-b8b648019f13\") "
Sep 11 19:44:01.419206 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.419172    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c46cd3fa-5992-447a-8e56-b8b648019f13" (UID: "c46cd3fa-5992-447a-8e56-b8b648019f13"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:44:01.420900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.420873    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c46cd3fa-5992-447a-8e56-b8b648019f13" (UID: "c46cd3fa-5992-447a-8e56-b8b648019f13"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:44:01.421010 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.420971    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg" (OuterVolumeSpecName: "kube-api-access-82dfg") pod "c46cd3fa-5992-447a-8e56-b8b648019f13" (UID: "c46cd3fa-5992-447a-8e56-b8b648019f13"). InnerVolumeSpecName "kube-api-access-82dfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:44:01.421010 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.420971    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c46cd3fa-5992-447a-8e56-b8b648019f13" (UID: "c46cd3fa-5992-447a-8e56-b8b648019f13"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:44:01.520685 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.520526    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:01.520685 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.520687    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c46cd3fa-5992-447a-8e56-b8b648019f13-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:01.520899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.520699    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c46cd3fa-5992-447a-8e56-b8b648019f13-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:01.520899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:01.520708    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82dfg\" (UniqueName: \"kubernetes.io/projected/c46cd3fa-5992-447a-8e56-b8b648019f13-kube-api-access-82dfg\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:02.310341 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:02.310262    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"
Sep 11 19:44:02.326537 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:02.326509    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:44:02.329763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:02.329734    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b20815-88df596fb-4fdz8"]
Sep 11 19:44:03.979227 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:03.979191    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c46cd3fa-5992-447a-8e56-b8b648019f13" path="/var/lib/kubelet/pods/c46cd3fa-5992-447a-8e56-b8b648019f13/volumes"
Sep 11 19:44:07.891648 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:07.891615    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:44:07.892100 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:07.891849    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy" containerID="cri-o://426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952" gracePeriod=30
Sep 11 19:44:10.802763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:10.802732    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:44:13.168612 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.168536    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:44:13.338752 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338721    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.338959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338792    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.338959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338853    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.338959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338877    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.338959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338913    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.338959 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338939    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.339221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.338969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.339221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339027    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.339221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339079    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqtfz\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz\") pod \"38eaff01-c54e-4545-8d2f-98110e01a156\" (UID: \"38eaff01-c54e-4545-8d2f-98110e01a156\") "
Sep 11 19:44:13.339221 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339110    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:44:13.339420 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339299    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data" (OuterVolumeSpecName: "istio-data") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:44:13.339420 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339309    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:44:13.339420 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339317    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:44:13.339632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339509    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:44:13.339632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339534    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.339632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339578    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/38eaff01-c54e-4545-8d2f-98110e01a156-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.339632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339592    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.339632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.339601    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.341026 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.341002    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token" (OuterVolumeSpecName: "istio-token") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:44:13.341479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.341449    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz" (OuterVolumeSpecName: "kube-api-access-jqtfz") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "kube-api-access-jqtfz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:44:13.341479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.341453    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:44:13.341479 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.341455    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "38eaff01-c54e-4545-8d2f-98110e01a156" (UID: "38eaff01-c54e-4545-8d2f-98110e01a156"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:44:13.369713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.369685    2562 generic.go:356] "Generic (PLEG): container finished" podID="38eaff01-c54e-4545-8d2f-98110e01a156" containerID="426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952" exitCode=0
Sep 11 19:44:13.369838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.369734    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"
Sep 11 19:44:13.369838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.369738    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerDied","Data":"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"}
Sep 11 19:44:13.369927 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.369848    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42" event={"ID":"38eaff01-c54e-4545-8d2f-98110e01a156","Type":"ContainerDied","Data":"6e883a2aff2fa716c7734ee2e5c15a0fc4d85cbe39e0e8dfd37ebc168791169e"}
Sep 11 19:44:13.369927 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.369870    2562 scope.go:117] "RemoveContainer" containerID="426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"
Sep 11 19:44:13.379070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.379050    2562 scope.go:117] "RemoveContainer" containerID="d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"
Sep 11 19:44:13.387048 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.387032    2562 scope.go:117] "RemoveContainer" containerID="426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"
Sep 11 19:44:13.387311 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:44:13.387294    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952\": container with ID starting with 426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952 not found: ID does not exist" containerID="426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"
Sep 11 19:44:13.387356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.387319    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952"} err="failed to get container status \"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952\": rpc error: code = NotFound desc = could not find container \"426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952\": container with ID starting with 426109008b364d9a8224b2754f04ed9149e906af18d3537ae35b5209b6e7b952 not found: ID does not exist"
Sep 11 19:44:13.387356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.387336    2562 scope.go:117] "RemoveContainer" containerID="d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"
Sep 11 19:44:13.387617 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:44:13.387599    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb\": container with ID starting with d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb not found: ID does not exist" containerID="d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"
Sep 11 19:44:13.387657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.387623    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb"} err="failed to get container status \"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb\": rpc error: code = NotFound desc = could not find container \"d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb\": container with ID starting with d480bafc8afaa97b6c0c1bdd934f5c29b46bb4e30c5ee59b6514bbe713a1efeb not found: ID does not exist"
Sep 11 19:44:13.391533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.391512    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:44:13.395922 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.395902    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b20815-openshift-default-598fd47968-xpp42"]
Sep 11 19:44:13.440156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.440100    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqtfz\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-kube-api-access-jqtfz\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.440156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.440120    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/38eaff01-c54e-4545-8d2f-98110e01a156-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.440156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.440130    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.440156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.440138    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/38eaff01-c54e-4545-8d2f-98110e01a156-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.440156 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.440146    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/38eaff01-c54e-4545-8d2f-98110e01a156-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:44:13.979860 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:13.979829    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" path="/var/lib/kubelet/pods/38eaff01-c54e-4545-8d2f-98110e01a156/volumes"
Sep 11 19:44:20.316721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:20.316687    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:44:58.207404 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:44:58.207330    2562 scope.go:117] "RemoveContainer" containerID="52a038a71639ee81180d7df548309ff9b11fc28d6cf7e29714a9134067d627e6"
Sep 11 19:45:00.142209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142176    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"]
Sep 11 19:45:00.142633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142617    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:45:00.142633 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142634    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142647    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c46cd3fa-5992-447a-8e56-b8b648019f13" containerName="maas-api"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142654    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c46cd3fa-5992-447a-8e56-b8b648019f13" containerName="maas-api"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142664    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142668    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142677    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1efec23-b2a8-45a5-976f-9547cd81b72c" containerName="maas-api"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142681    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1efec23-b2a8-45a5-976f-9547cd81b72c" containerName="maas-api"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142688    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142693    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142701    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142706    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:45:00.142713 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142716    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142721    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142789    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142797    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142803    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142812    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c46cd3fa-5992-447a-8e56-b8b648019f13" containerName="maas-api"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142817    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1efec23-b2a8-45a5-976f-9547cd81b72c" containerName="maas-api"
Sep 11 19:45:00.143085 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.142823    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:45:00.145771 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.145749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"
Sep 11 19:45:00.148228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.148205    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-p6jwt\""
Sep 11 19:45:00.153880 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.153854    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"]
Sep 11 19:45:00.158683 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.158663    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"
Sep 11 19:45:00.427238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.427212    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"]
Sep 11 19:45:00.429214 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:45:00.429186    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018147b3_30df_4892_b06b_67089a0fc116.slice/crio-cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45 WatchSource:0}: Error finding container cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45: Status 404 returned error can't find the container with id cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45
Sep 11 19:45:00.615008 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:00.614967    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x" event={"ID":"018147b3-30df-4892-b06b-67089a0fc116","Type":"ContainerStarted","Data":"cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45"}
Sep 11 19:45:03.635636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:03.635593    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x" event={"ID":"018147b3-30df-4892-b06b-67089a0fc116","Type":"ContainerStarted","Data":"9fd706989a721240a8dcb84ef8165af5a2d29eb9a9b723281beebda0020e52be"}
Sep 11 19:45:03.651637 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:03.651586    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x" podStartSLOduration=1.231703457 podStartE2EDuration="3.65157197s" totalImagesPullingTime="2.419868513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:45:03.650806485 +0000 UTC m=+1626.183862627" watchObservedRunningTime="2026-09-11 19:45:03.65157197 +0000 UTC m=+1626.184628088"
Sep 11 19:45:04.642521 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:04.642484    2562 generic.go:356] "Generic (PLEG): container finished" podID="018147b3-30df-4892-b06b-67089a0fc116" containerID="9fd706989a721240a8dcb84ef8165af5a2d29eb9a9b723281beebda0020e52be" exitCode=0
Sep 11 19:45:04.642919 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:04.642575    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x" event={"ID":"018147b3-30df-4892-b06b-67089a0fc116","Type":"ContainerDied","Data":"9fd706989a721240a8dcb84ef8165af5a2d29eb9a9b723281beebda0020e52be"}
Sep 11 19:45:05.788088 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:05.788063    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"
Sep 11 19:45:06.654151 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:06.654120    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"
Sep 11 19:45:06.654361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:06.654152    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x" event={"ID":"018147b3-30df-4892-b06b-67089a0fc116","Type":"ContainerDied","Data":"cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45"}
Sep 11 19:45:06.654361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:06.654204    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf5c9e5a7513f1bf5c278040aeaeb1de87af06d53e3b14abbe3062bc99c9bb45"
Sep 11 19:45:24.096459 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:24.096415    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:45:41.302251 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:41.302214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:45:57.003560 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:45:57.003516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:46:06.915175 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:06.915134    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:46:25.700269 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700190    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700590    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700603    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700624    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700629    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700638    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018147b3-30df-4892-b06b-67089a0fc116" containerName="cleanup"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700643    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="018147b3-30df-4892-b06b-67089a0fc116" containerName="cleanup"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700650    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700656    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:46:25.700710 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700714    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="018147b3-30df-4892-b06b-67089a0fc116" containerName="cleanup"
Sep 11 19:46:25.700988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700722    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c621e364-7038-41f5-9ce9-34196ef152e3" containerName="istio-proxy"
Sep 11 19:46:25.700988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700729    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="38eaff01-c54e-4545-8d2f-98110e01a156" containerName="istio-proxy"
Sep 11 19:46:25.700988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700734    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eab0c536-bf9e-4332-9fb8-265ce522a569" containerName="istio-proxy"
Sep 11 19:46:25.700988 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.700742    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="4733a67e-9b6e-4bc9-831a-5edc920270d5" containerName="istio-proxy"
Sep 11 19:46:25.704035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.704017    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.707714 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.707631    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abcdff\"/\"openshift-service-ca.crt\""
Sep 11 19:46:25.708300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.707991    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abcdff\"/\"default-dockercfg-lv6pr\""
Sep 11 19:46:25.708300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.708074    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-abcdff\"/\"rate-test-model-abcdff-kserve-self-signed-certs\""
Sep 11 19:46:25.708300 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.708080    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-abcdff\"/\"kube-root-ca.crt\""
Sep 11 19:46:25.714127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.714101    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:46:25.772356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.772538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.772538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772414    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqrbk\" (UniqueName: \"kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.772538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.772538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772496    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.772538 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.772524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.873863 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.873822    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.873870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xqrbk\" (UniqueName: \"kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.873912    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.873941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.873965    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.874009    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874325 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.874295    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874381 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.874308    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.874424 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.874396    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.876242 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.876213    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.876631 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.876614    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:25.882791 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:25.882767    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqrbk\" (UniqueName: \"kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk\") pod \"rate-test-model-abcdff-kserve-668668f479-g6d5l\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") " pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:26.015589 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:26.015494    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:26.288903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:26.288876    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:46:26.290743 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:46:26.290719    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod77988926_16f9_4e96_a7fb_dd27ac74c207.slice/crio-599ee511de9b56c6365194f26ffb0980f32cf247d316db2f71e1ce2b8915b6d4 WatchSource:0}: Error finding container 599ee511de9b56c6365194f26ffb0980f32cf247d316db2f71e1ce2b8915b6d4: Status 404 returned error can't find the container with id 599ee511de9b56c6365194f26ffb0980f32cf247d316db2f71e1ce2b8915b6d4
Sep 11 19:46:27.066349 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:27.066310    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" event={"ID":"77988926-16f9-4e96-a7fb-dd27ac74c207","Type":"ContainerStarted","Data":"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"}
Sep 11 19:46:27.066774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:27.066361    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" event={"ID":"77988926-16f9-4e96-a7fb-dd27ac74c207","Type":"ContainerStarted","Data":"599ee511de9b56c6365194f26ffb0980f32cf247d316db2f71e1ce2b8915b6d4"}
Sep 11 19:46:27.086134 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:27.086078    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" podStartSLOduration=2.086062114 podStartE2EDuration="2.086062114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:46:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:46:27.085202856 +0000 UTC m=+1709.618258977" watchObservedRunningTime="2026-09-11 19:46:27.086062114 +0000 UTC m=+1709.619118234"
Sep 11 19:46:29.705962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:29.705922    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:46:36.015635 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:36.015597    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:36.015635 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:36.015644    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:36.028380 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:36.028350    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:36.127311 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:36.127283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:46:45.803274 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:46:45.803238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:47:00.906835 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:00.906797    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:47:05.795339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:05.795301    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:47:06.910581 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:06.910530    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:47:16.305048 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:16.305009    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:47:20.815668 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:20.815620    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" podUID="77988926-16f9-4e96-a7fb-dd27ac74c207" containerName="main" containerID="cri-o://4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf" gracePeriod=45
Sep 11 19:47:21.066911 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.066846    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:47:21.207709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207673    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.207908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207721    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.207908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207747    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.207908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207831    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.207908 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207898    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xqrbk\" (UniqueName: \"kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.208129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.207934    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs\") pod \"77988926-16f9-4e96-a7fb-dd27ac74c207\" (UID: \"77988926-16f9-4e96-a7fb-dd27ac74c207\") "
Sep 11 19:47:21.208129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208024    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home" (OuterVolumeSpecName: "home") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:47:21.208129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208026    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:47:21.208129 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208066    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache" (OuterVolumeSpecName: "model-cache") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:47:21.208308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208269    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-home\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.208308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208287    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-tmp-dir\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.208308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.208297    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-model-cache\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.210172 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.210134    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk" (OuterVolumeSpecName: "kube-api-access-xqrbk") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "kube-api-access-xqrbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:47:21.210301 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.210257    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:47:21.210356 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.210331    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm" (OuterVolumeSpecName: "dshm") pod "77988926-16f9-4e96-a7fb-dd27ac74c207" (UID: "77988926-16f9-4e96-a7fb-dd27ac74c207"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:47:21.309618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.309583    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/77988926-16f9-4e96-a7fb-dd27ac74c207-dshm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.309618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.309613    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xqrbk\" (UniqueName: \"kubernetes.io/projected/77988926-16f9-4e96-a7fb-dd27ac74c207-kube-api-access-xqrbk\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.309618 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.309625    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77988926-16f9-4e96-a7fb-dd27ac74c207-tls-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:47:21.358614 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.358577    2562 generic.go:356] "Generic (PLEG): container finished" podID="77988926-16f9-4e96-a7fb-dd27ac74c207" containerID="4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf" exitCode=0
Sep 11 19:47:21.358777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.358628    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"
Sep 11 19:47:21.358777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.358663    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" event={"ID":"77988926-16f9-4e96-a7fb-dd27ac74c207","Type":"ContainerDied","Data":"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"}
Sep 11 19:47:21.358777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.358712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l" event={"ID":"77988926-16f9-4e96-a7fb-dd27ac74c207","Type":"ContainerDied","Data":"599ee511de9b56c6365194f26ffb0980f32cf247d316db2f71e1ce2b8915b6d4"}
Sep 11 19:47:21.358777 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.358725    2562 scope.go:117] "RemoveContainer" containerID="4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"
Sep 11 19:47:21.367911 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.367894    2562 scope.go:117] "RemoveContainer" containerID="4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"
Sep 11 19:47:21.368177 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:47:21.368159    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf\": container with ID starting with 4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf not found: ID does not exist" containerID="4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"
Sep 11 19:47:21.368242 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.368184    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf"} err="failed to get container status \"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf\": rpc error: code = NotFound desc = could not find container \"4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf\": container with ID starting with 4e6651aabbd65a82cc68e74cca15d84f951bac48e8baa0e4bd6655f8548c2adf not found: ID does not exist"
Sep 11 19:47:21.378712 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.378688    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:47:21.382261 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.382239    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-abcdff/rate-test-model-abcdff-kserve-668668f479-g6d5l"]
Sep 11 19:47:21.978864 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:21.978829    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77988926-16f9-4e96-a7fb-dd27ac74c207" path="/var/lib/kubelet/pods/77988926-16f9-4e96-a7fb-dd27ac74c207/volumes"
Sep 11 19:47:35.370070 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.370026    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:47:35.370734 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.370710    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77988926-16f9-4e96-a7fb-dd27ac74c207" containerName="main"
Sep 11 19:47:35.370915 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.370902    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="77988926-16f9-4e96-a7fb-dd27ac74c207" containerName="main"
Sep 11 19:47:35.371754 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.371735    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="77988926-16f9-4e96-a7fb-dd27ac74c207" containerName="main"
Sep 11 19:47:35.375385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.375366    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.377760 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.377739    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-904b94-openshift-default-dockercfg-j6pkc\""
Sep 11 19:47:35.386067 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.386043    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:47:35.440308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440265    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440321    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440381    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440567    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zjdw\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440621    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.440705 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.440638    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541313 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541270    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541313 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541309    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541333    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zjdw\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541510    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541586 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541791    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.541938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541829    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.542037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.542037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.541950    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.542470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.542447    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.543872 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.543850    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.544060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.544044    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.549800 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.549775    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.550048 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.550025    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zjdw\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw\") pod \"e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") " pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.686288 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.686196    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:35.962888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.962860    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:47:35.964534 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:47:35.964510    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5591dc6e_0df0_4804_9341_a050cf7536db.slice/crio-ce32a4ead1d428145d633b1f28c65c232947337e438b45bd59b9e43fc6731164 WatchSource:0}: Error finding container ce32a4ead1d428145d633b1f28c65c232947337e438b45bd59b9e43fc6731164: Status 404 returned error can't find the container with id ce32a4ead1d428145d633b1f28c65c232947337e438b45bd59b9e43fc6731164
Sep 11 19:47:35.966779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.966744    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:35.966855 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.966811    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:35.966897 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:35.966855    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:36.446569 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:36.446497    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerStarted","Data":"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"}
Sep 11 19:47:36.447042 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:36.446613    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerStarted","Data":"ce32a4ead1d428145d633b1f28c65c232947337e438b45bd59b9e43fc6731164"}
Sep 11 19:47:36.466298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:36.466213    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podStartSLOduration=1.466193251 podStartE2EDuration="1.466193251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:47:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:47:36.465587834 +0000 UTC m=+1778.998643975" watchObservedRunningTime="2026-09-11 19:47:36.466193251 +0000 UTC m=+1778.999249372"
Sep 11 19:47:36.686433 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:36.686395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:37.692033 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:37.692004    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:38.458121 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:38.458090    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:38.459132 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:38.459108    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:45.002733 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:45.002690    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:47:54.499718 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:54.499676    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 19:47:54.500153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:54.499756    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 19:47:56.563532 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.563442    2562 generic.go:356] "Generic (PLEG): container finished" podID="5591dc6e-0df0-4804-9341-a050cf7536db" containerID="b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479" exitCode=0
Sep 11 19:47:56.564047 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.563518    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerDied","Data":"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"}
Sep 11 19:47:56.564128 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.564059    2562 scope.go:117] "RemoveContainer" containerID="b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"
Sep 11 19:47:56.565163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.565132    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:56.565252 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.565204    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:56.565252 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:56.565235    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:47:57.576363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:57.576322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerStarted","Data":"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"}
Sep 11 19:47:57.686667 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:57.686626    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:47:57.686971 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:57.686949    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:47:57.687023 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:57.687003    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:47:58.082567 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:58.082511    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:47:58.084076 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:58.084047    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:47:58.687326 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:58.687294    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:47:58.687723 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:58.687344    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:47:59.687378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:59.687345    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:47:59.687812 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:47:59.687426    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:48:00.687347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:00.687307    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:48:00.687536 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:00.687367    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:48:01.686973 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:01.686932    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:48:01.687157 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:01.686992    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:48:02.686940 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:02.686901    2562 patch_prober.go:28] interesting pod/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 11 19:48:02.687423 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:02.686969    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 11 19:48:03.690979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:03.690948    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:48:03.691378 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:03.691227    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:48:03.691808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:03.691792    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:48:16.402936 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.402896    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:48:16.406809 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.406789    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.410943 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.410917    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c0a42d\"/\"default-dockercfg-tnc5b\""
Sep 11 19:48:16.411078 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.410917    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c0a42d\"/\"kube-root-ca.crt\""
Sep 11 19:48:16.411078 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.410926    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-c0a42d\"/\"openshift-service-ca.crt\""
Sep 11 19:48:16.411078 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.410925    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-c0a42d\"/\"ipp-route-c0a42d-kserve-self-signed-certs\""
Sep 11 19:48:16.416766 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.416740    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:48:16.544177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544140    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.544339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544193    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njfgt\" (UniqueName: \"kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.544339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544281    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.544339 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.544442 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.544442 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.544422    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645341 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645305    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njfgt\" (UniqueName: \"kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645531 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645359    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645531 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645531 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645531 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645432    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645531 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645483    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645880    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.645974 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.645937    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.646139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.646115    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.648405 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.648349    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.648719 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.648699    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.656312 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.656259    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njfgt\" (UniqueName: \"kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt\") pod \"ipp-route-c0a42d-kserve-548f4b84b7-qcw7x\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") " pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.717358 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.717327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:16.988937 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:16.988910    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:48:16.990738 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:48:16.990711    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd5b5abf1_b9e9_4826_977f_576887b27096.slice/crio-40060cc1efe6533ca8d6ed9ae12aa8353ba38ab3308605d8efae06781a18efdd WatchSource:0}: Error finding container 40060cc1efe6533ca8d6ed9ae12aa8353ba38ab3308605d8efae06781a18efdd: Status 404 returned error can't find the container with id 40060cc1efe6533ca8d6ed9ae12aa8353ba38ab3308605d8efae06781a18efdd
Sep 11 19:48:17.683376 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:17.683336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" event={"ID":"d5b5abf1-b9e9-4826-977f-576887b27096","Type":"ContainerStarted","Data":"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"}
Sep 11 19:48:17.683376 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:17.683375    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" event={"ID":"d5b5abf1-b9e9-4826-977f-576887b27096","Type":"ContainerStarted","Data":"40060cc1efe6533ca8d6ed9ae12aa8353ba38ab3308605d8efae06781a18efdd"}
Sep 11 19:48:17.704036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:17.703990    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" podStartSLOduration=1.703975633 podStartE2EDuration="1.703975633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:17.702495292 +0000 UTC m=+1820.235551413" watchObservedRunningTime="2026-09-11 19:48:17.703975633 +0000 UTC m=+1820.237031754"
Sep 11 19:48:21.200825 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:21.200783    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:48:26.718415 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:26.718370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:26.718897 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:26.718432    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:26.730975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:26.730941    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:26.745817 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:26.745791    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:48:42.999902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:42.999865    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:48:49.971758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:49.971722    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:48:49.975660 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:49.975633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:49.978721 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:49.978698    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-40573d-openshift-default-dockercfg-2gnfj\""
Sep 11 19:48:49.994688 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:49.994629    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:48:50.071525 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071605    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071729 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071748    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071839 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071793    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071905 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071840    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071940 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssfw\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.071987 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.071973    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173361 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173323    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173371    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173470    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173534 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173524    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssfw\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173620    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.173888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.173879    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.174054 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.174027    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.174104 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.174063    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.174144 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.174111    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.174206 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.174188    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.175824 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.175803    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.176019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.176000    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.181703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.181679    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.181885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.181866    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssfw\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw\") pod \"e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") " pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.287292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.287203    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:50.562363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.562334    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:48:50.564281 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:48:50.564252    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07d238fe_5493_43f8_836a_5028328d824c.slice/crio-b9e8af0f3281cebcafe0edd7f3c3e6fcf62ad3b8272dc3f1cfd316d455c1c646 WatchSource:0}: Error finding container b9e8af0f3281cebcafe0edd7f3c3e6fcf62ad3b8272dc3f1cfd316d455c1c646: Status 404 returned error can't find the container with id b9e8af0f3281cebcafe0edd7f3c3e6fcf62ad3b8272dc3f1cfd316d455c1c646
Sep 11 19:48:50.567013 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.566972    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:48:50.567110 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.567067    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:48:50.567162 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.567110    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:48:50.860391 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.860354    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerStarted","Data":"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"}
Sep 11 19:48:50.860562 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.860445    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerStarted","Data":"b9e8af0f3281cebcafe0edd7f3c3e6fcf62ad3b8272dc3f1cfd316d455c1c646"}
Sep 11 19:48:50.881607 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:50.881521    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podStartSLOduration=1.8815017040000002 podStartE2EDuration="1.881501704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:48:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:48:50.879240658 +0000 UTC m=+1853.412296805" watchObservedRunningTime="2026-09-11 19:48:50.881501704 +0000 UTC m=+1853.414557822"
Sep 11 19:48:51.287850 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:51.287753    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:51.292992 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:51.292963    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:51.865602 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:51.865570    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:48:51.866699 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:48:51.866676    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:01.527430 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:01.527395    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:49:12.003435 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.003344    2562 generic.go:356] "Generic (PLEG): container finished" podID="07d238fe-5493-43f8-836a-5028328d824c" containerID="52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc" exitCode=0
Sep 11 19:49:12.003963 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.003422    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerDied","Data":"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"}
Sep 11 19:49:12.003963 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.003956    2562 scope.go:117] "RemoveContainer" containerID="52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"
Sep 11 19:49:12.005153 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.005122    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:49:12.005217 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.005205    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:49:12.005258 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:12.005242    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 11 19:49:13.010952 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:13.010921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerStarted","Data":"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"}
Sep 11 19:49:13.287758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:13.287672    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:13.287913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:13.287871    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:49:13.287957 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:13.287919    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 11 19:49:14.288150 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:14.288117    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:49:14.288610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:14.288175    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 11 19:49:15.287979 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:15.287934    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:49:15.288172 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:15.288025    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 11 19:49:16.287940 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:16.287896    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:49:16.288159 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:16.287960    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 11 19:49:17.288114 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:17.288076    2562 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body=
Sep 11 19:49:17.288509 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:17.288145    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused"
Sep 11 19:49:18.292470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:18.292433    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:18.292856 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:18.292749    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:18.293463 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:18.293446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:38.703661 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:38.703627    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:49:41.341664 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:41.341629    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:49:41.342074 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:41.341872    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy" containerID="cri-o://8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b" gracePeriod=30
Sep 11 19:49:46.606580 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.606482    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:46.730970 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.730935    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.730982    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731028    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ssfw\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731077    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731099    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731135    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731174    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731234    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731269    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs\") pod \"07d238fe-5493-43f8-836a-5028328d824c\" (UID: \"07d238fe-5493-43f8-836a-5028328d824c\") "
Sep 11 19:49:46.731402 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731374    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:49:46.731637 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731423    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:49:46.731696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731651    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.731696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731672    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07d238fe-5493-43f8-836a-5028328d824c-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.731696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731654    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:49:46.731900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731740    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:49:46.731900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.731808    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data" (OuterVolumeSpecName: "istio-data") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:49:46.733506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.733477    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token" (OuterVolumeSpecName: "istio-token") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:46.733643 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.733524    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:49:46.733828 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.733805    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw" (OuterVolumeSpecName: "kube-api-access-2ssfw") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "kube-api-access-2ssfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:49:46.733910 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.733892    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07d238fe-5493-43f8-836a-5028328d824c" (UID: "07d238fe-5493-43f8-836a-5028328d824c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:49:46.832751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832709    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.832751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832744    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07d238fe-5493-43f8-836a-5028328d824c-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.832751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832756    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.832751 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832764    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.833031 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832772    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07d238fe-5493-43f8-836a-5028328d824c-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.833031 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832779    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:46.833031 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:46.832789    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ssfw\" (UniqueName: \"kubernetes.io/projected/07d238fe-5493-43f8-836a-5028328d824c-kube-api-access-2ssfw\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:49:47.189994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.189958    2562 generic.go:356] "Generic (PLEG): container finished" podID="07d238fe-5493-43f8-836a-5028328d824c" containerID="8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b" exitCode=0
Sep 11 19:49:47.190177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.190010    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"
Sep 11 19:49:47.190177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.190040    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerDied","Data":"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"}
Sep 11 19:49:47.190177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.190101    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk" event={"ID":"07d238fe-5493-43f8-836a-5028328d824c","Type":"ContainerDied","Data":"b9e8af0f3281cebcafe0edd7f3c3e6fcf62ad3b8272dc3f1cfd316d455c1c646"}
Sep 11 19:49:47.190177 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.190133    2562 scope.go:117] "RemoveContainer" containerID="8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"
Sep 11 19:49:47.205178 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.205157    2562 scope.go:117] "RemoveContainer" containerID="52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"
Sep 11 19:49:47.214649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.214629    2562 scope.go:117] "RemoveContainer" containerID="8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"
Sep 11 19:49:47.214949 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:49:47.214928    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b\": container with ID starting with 8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b not found: ID does not exist" containerID="8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"
Sep 11 19:49:47.215015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.214958    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b"} err="failed to get container status \"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b\": rpc error: code = NotFound desc = could not find container \"8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b\": container with ID starting with 8f5363f3ea2c82c033ca20efcc03558cc259a58e7878bad7fdbf578f5a459b6b not found: ID does not exist"
Sep 11 19:49:47.215015 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.214975    2562 scope.go:117] "RemoveContainer" containerID="52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"
Sep 11 19:49:47.215225 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:49:47.215207    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc\": container with ID starting with 52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc not found: ID does not exist" containerID="52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"
Sep 11 19:49:47.215263 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.215230    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc"} err="failed to get container status \"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc\": rpc error: code = NotFound desc = could not find container \"52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc\": container with ID starting with 52d30343e3a7cfa19db76b63dc3d08cecf2534788546e56cc8c48e6c2374e3dc not found: ID does not exist"
Sep 11 19:49:47.223854 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.223832    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:49:47.233204 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.233181    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-40573d-openshift-default-597ccddc8b-n44qk"]
Sep 11 19:49:47.980069 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:47.980038    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07d238fe-5493-43f8-836a-5028328d824c" path="/var/lib/kubelet/pods/07d238fe-5493-43f8-836a-5028328d824c/volumes"
Sep 11 19:49:57.910747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:49:57.910704    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:50:05.873222 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:05.873185    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:50:11.113788 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:11.113751    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:50:20.892775 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:20.892713    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" podUID="d5b5abf1-b9e9-4826-977f-576887b27096" containerName="main" containerID="cri-o://c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e" gracePeriod=45
Sep 11 19:50:21.146984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.146915    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:50:21.166059 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166026    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166148    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166239 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166197    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166249    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njfgt\" (UniqueName: \"kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166282    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166340 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166309    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir\") pod \"d5b5abf1-b9e9-4826-977f-576887b27096\" (UID: \"d5b5abf1-b9e9-4826-977f-576887b27096\") "
Sep 11 19:50:21.166476 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166357    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home" (OuterVolumeSpecName: "home") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:21.166617 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166599    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-home\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.166961 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166825    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:21.166961 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.166935    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache" (OuterVolumeSpecName: "model-cache") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:21.169087 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.169062    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm" (OuterVolumeSpecName: "dshm") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:50:21.169200 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.169051    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:50:21.169200 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.169087    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt" (OuterVolumeSpecName: "kube-api-access-njfgt") pod "d5b5abf1-b9e9-4826-977f-576887b27096" (UID: "d5b5abf1-b9e9-4826-977f-576887b27096"). InnerVolumeSpecName "kube-api-access-njfgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:50:21.267266 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.267227    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d5b5abf1-b9e9-4826-977f-576887b27096-tls-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.267266 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.267258    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njfgt\" (UniqueName: \"kubernetes.io/projected/d5b5abf1-b9e9-4826-977f-576887b27096-kube-api-access-njfgt\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.267266 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.267268    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-model-cache\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.267266 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.267277    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-tmp-dir\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.267629 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.267284    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d5b5abf1-b9e9-4826-977f-576887b27096-dshm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:50:21.372419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.372383    2562 generic.go:356] "Generic (PLEG): container finished" podID="d5b5abf1-b9e9-4826-977f-576887b27096" containerID="c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e" exitCode=0
Sep 11 19:50:21.372630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.372424    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"
Sep 11 19:50:21.372630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.372472    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" event={"ID":"d5b5abf1-b9e9-4826-977f-576887b27096","Type":"ContainerDied","Data":"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"}
Sep 11 19:50:21.372630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.372513    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x" event={"ID":"d5b5abf1-b9e9-4826-977f-576887b27096","Type":"ContainerDied","Data":"40060cc1efe6533ca8d6ed9ae12aa8353ba38ab3308605d8efae06781a18efdd"}
Sep 11 19:50:21.372630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.372534    2562 scope.go:117] "RemoveContainer" containerID="c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"
Sep 11 19:50:21.381726 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.381709    2562 scope.go:117] "RemoveContainer" containerID="c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"
Sep 11 19:50:21.382015 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:50:21.381996    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e\": container with ID starting with c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e not found: ID does not exist" containerID="c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"
Sep 11 19:50:21.382080 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.382029    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e"} err="failed to get container status \"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e\": rpc error: code = NotFound desc = could not find container \"c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e\": container with ID starting with c5ea8c8bf2187d2e0ad4bb593de76ed5e1ebf23750069c20de0c78f68c30957e not found: ID does not exist"
Sep 11 19:50:21.393506 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.393482    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:50:21.399395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.399339    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-c0a42d/ipp-route-c0a42d-kserve-548f4b84b7-qcw7x"]
Sep 11 19:50:21.979166 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:50:21.979125    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5b5abf1-b9e9-4826-977f-576887b27096" path="/var/lib/kubelet/pods/d5b5abf1-b9e9-4826-977f-576887b27096/volumes"
Sep 11 19:51:08.707461 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:08.707425    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:51:11.842831 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:11.842791    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:51:11.843281 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:11.843078    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy" containerID="cri-o://ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2" gracePeriod=30
Sep 11 19:51:17.093621 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.093593    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:51:17.206409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206313    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206357    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206395    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206411    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206456    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206474    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206505    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206586    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zjdw\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.206808 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206631    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs\") pod \"5591dc6e-0df0-4804-9341-a050cf7536db\" (UID: \"5591dc6e-0df0-4804-9341-a050cf7536db\") "
Sep 11 19:51:17.207060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206838    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:17.207060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206873    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data" (OuterVolumeSpecName: "istio-data") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:17.207060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206847    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:17.207060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.206922    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:17.207060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.207011    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.207322 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.207072    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:17.208743 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.208707    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token" (OuterVolumeSpecName: "istio-token") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:17.208743 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.208734    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:51:17.208955 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.208917    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw" (OuterVolumeSpecName: "kube-api-access-5zjdw") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "kube-api-access-5zjdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:17.209081 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.209061    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5591dc6e-0df0-4804-9341-a050cf7536db" (UID: "5591dc6e-0df0-4804-9341-a050cf7536db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:17.308019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.307979    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308012    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5591dc6e-0df0-4804-9341-a050cf7536db-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308024    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308032    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5591dc6e-0df0-4804-9341-a050cf7536db-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308041    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308050    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308058    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zjdw\" (UniqueName: \"kubernetes.io/projected/5591dc6e-0df0-4804-9341-a050cf7536db-kube-api-access-5zjdw\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.308292 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.308066    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5591dc6e-0df0-4804-9341-a050cf7536db-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:17.663724 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.663689    2562 generic.go:356] "Generic (PLEG): container finished" podID="5591dc6e-0df0-4804-9341-a050cf7536db" containerID="ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2" exitCode=0
Sep 11 19:51:17.663903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.663745    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"
Sep 11 19:51:17.663903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.663770    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerDied","Data":"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"}
Sep 11 19:51:17.663903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.663828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t" event={"ID":"5591dc6e-0df0-4804-9341-a050cf7536db","Type":"ContainerDied","Data":"ce32a4ead1d428145d633b1f28c65c232947337e438b45bd59b9e43fc6731164"}
Sep 11 19:51:17.663903 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.663852    2562 scope.go:117] "RemoveContainer" containerID="ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"
Sep 11 19:51:17.684975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.684950    2562 scope.go:117] "RemoveContainer" containerID="b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"
Sep 11 19:51:17.693720 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.693698    2562 scope.go:117] "RemoveContainer" containerID="ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"
Sep 11 19:51:17.693987 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:51:17.693968    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2\": container with ID starting with ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2 not found: ID does not exist" containerID="ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"
Sep 11 19:51:17.694060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.693993    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2"} err="failed to get container status \"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2\": rpc error: code = NotFound desc = could not find container \"ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2\": container with ID starting with ceca286e25a6255ccbeaaf64e024fa4c9162e1fa56eba3cc0bfc85425fc33ea2 not found: ID does not exist"
Sep 11 19:51:17.694060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.694009    2562 scope.go:117] "RemoveContainer" containerID="b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"
Sep 11 19:51:17.694251 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:51:17.694236    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479\": container with ID starting with b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479 not found: ID does not exist" containerID="b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"
Sep 11 19:51:17.694290 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.694254    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479"} err="failed to get container status \"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479\": rpc error: code = NotFound desc = could not find container \"b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479\": container with ID starting with b14c66cba96a619b4aa1f01b2ed4f6e6687b7eff10b916e02e6d31a2fa1e7479 not found: ID does not exist"
Sep 11 19:51:17.700139 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.700110    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:51:17.703838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.703813    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-904b94-openshift-default-67695fcff6-m2p2t"]
Sep 11 19:51:17.979092 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:17.979014    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" path="/var/lib/kubelet/pods/5591dc6e-0df0-4804-9341-a050cf7536db/volumes"
Sep 11 19:51:22.671228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:22.671195    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:51:22.671672 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:22.671418    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" podUID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" containerName="maas-api" containerID="cri-o://04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7" gracePeriod=30
Sep 11 19:51:22.706706 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:22.706678    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"]
Sep 11 19:51:22.709318 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:22.709295    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-19859a-29819265-qnx6x"]
Sep 11 19:51:22.925218 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:22.925157    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:51:23.063419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063383    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls\") pod \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") "
Sep 11 19:51:23.063636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063451    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca\") pod \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") "
Sep 11 19:51:23.063636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063494    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4glmr\" (UniqueName: \"kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr\") pod \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") "
Sep 11 19:51:23.063636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063626    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs\") pod \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\" (UID: \"65144a53-f0ba-4ffb-aaef-d1420003d6cf\") "
Sep 11 19:51:23.063870 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063838    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "65144a53-f0ba-4ffb-aaef-d1420003d6cf" (UID: "65144a53-f0ba-4ffb-aaef-d1420003d6cf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:23.063981 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.063961    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/65144a53-f0ba-4ffb-aaef-d1420003d6cf-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.065696 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.065670    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "65144a53-f0ba-4ffb-aaef-d1420003d6cf" (UID: "65144a53-f0ba-4ffb-aaef-d1420003d6cf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:51:23.066116 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.066096    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "65144a53-f0ba-4ffb-aaef-d1420003d6cf" (UID: "65144a53-f0ba-4ffb-aaef-d1420003d6cf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:51:23.066171 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.066109    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr" (OuterVolumeSpecName: "kube-api-access-4glmr") pod "65144a53-f0ba-4ffb-aaef-d1420003d6cf" (UID: "65144a53-f0ba-4ffb-aaef-d1420003d6cf"). InnerVolumeSpecName "kube-api-access-4glmr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:23.164709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.164669    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4glmr\" (UniqueName: \"kubernetes.io/projected/65144a53-f0ba-4ffb-aaef-d1420003d6cf-kube-api-access-4glmr\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.164709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.164702    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.164709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.164711    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/65144a53-f0ba-4ffb-aaef-d1420003d6cf-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:23.699333 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.699300    2562 generic.go:356] "Generic (PLEG): container finished" podID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" containerID="04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7" exitCode=0
Sep 11 19:51:23.699784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.699345    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"
Sep 11 19:51:23.699784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.699380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" event={"ID":"65144a53-f0ba-4ffb-aaef-d1420003d6cf","Type":"ContainerDied","Data":"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"}
Sep 11 19:51:23.699784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.699438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh" event={"ID":"65144a53-f0ba-4ffb-aaef-d1420003d6cf","Type":"ContainerDied","Data":"e6eaa074e8901b4e6d2488d79312ccacab1e6e87f221d7a18ed7e38cf2f633b2"}
Sep 11 19:51:23.699784 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.699462    2562 scope.go:117] "RemoveContainer" containerID="04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"
Sep 11 19:51:23.709630 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.709611    2562 scope.go:117] "RemoveContainer" containerID="04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"
Sep 11 19:51:23.709934 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:51:23.709914    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7\": container with ID starting with 04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7 not found: ID does not exist" containerID="04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"
Sep 11 19:51:23.710011 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.709944    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7"} err="failed to get container status \"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7\": rpc error: code = NotFound desc = could not find container \"04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7\": container with ID starting with 04334e45bd8d45b2ef32db881f59b9597a0945621df0a63f69a6340954e009f7 not found: ID does not exist"
Sep 11 19:51:23.722359 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.722330    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:51:23.726449 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.726425    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-19859a-56994c8cf5-gbzjh"]
Sep 11 19:51:23.983619 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.983514    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018147b3-30df-4892-b06b-67089a0fc116" path="/var/lib/kubelet/pods/018147b3-30df-4892-b06b-67089a0fc116/volumes"
Sep 11 19:51:23.984008 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:23.983988    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" path="/var/lib/kubelet/pods/65144a53-f0ba-4ffb-aaef-d1420003d6cf/volumes"
Sep 11 19:51:25.701757 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:25.701720    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:51:29.409371 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:29.409336    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:51:29.409995 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:29.409629    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" containerID="cri-o://a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f" gracePeriod=30
Sep 11 19:51:32.986437 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:32.986398    2562 patch_prober.go:28] interesting pod/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 19:51:32.986852 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:32.986457    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 19:51:34.666854 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.666823    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:51:34.673371 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673346    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673401    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673442    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673506    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673540    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xbl67\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673593    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673619    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673647    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs\") pod \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\" (UID: \"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275\") "
Sep 11 19:51:34.673899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673717    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:34.673899 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673857    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:34.674060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673888    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:34.674060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673962    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:51:34.674060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.673972    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.674204 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.674004    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-credential-socket\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.674204 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.674077    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:34.675745 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.675682    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:51:34.675837 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.675800    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 19:51:34.676176 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.676151    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67" (OuterVolumeSpecName: "kube-api-access-xbl67") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "kube-api-access-xbl67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:34.676176 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.676165    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" (UID: "eb4bfec5-e34b-4b07-a1a0-2d093b7b6275"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:51:34.758833 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.758796    2562 generic.go:356] "Generic (PLEG): container finished" podID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerID="a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f" exitCode=0
Sep 11 19:51:34.759034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.758860    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"
Sep 11 19:51:34.759034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.758890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerDied","Data":"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"}
Sep 11 19:51:34.759034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.758968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc" event={"ID":"eb4bfec5-e34b-4b07-a1a0-2d093b7b6275","Type":"ContainerDied","Data":"36d8a31c1af2a2cfdbeb1f400c6521587c60e46e109562bbea3352a3a96aaa95"}
Sep 11 19:51:34.759034 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.758992    2562 scope.go:117] "RemoveContainer" containerID="a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"
Sep 11 19:51:34.768394 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.768377    2562 scope.go:117] "RemoveContainer" containerID="733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"
Sep 11 19:51:34.774907 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774884    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-podinfo\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774911    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-token\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774924    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-envoy\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774935    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbl67\" (UniqueName: \"kubernetes.io/projected/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-kube-api-access-xbl67\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774949    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istio-data\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774961    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-istiod-ca-cert\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.775019 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.774973    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275-workload-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:51:34.776351 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.776338    2562 scope.go:117] "RemoveContainer" containerID="a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"
Sep 11 19:51:34.776650 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:51:34.776629    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f\": container with ID starting with a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f not found: ID does not exist" containerID="a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"
Sep 11 19:51:34.776709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.776658    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f"} err="failed to get container status \"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f\": rpc error: code = NotFound desc = could not find container \"a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f\": container with ID starting with a8ab1fb6435b28e6d33da66cdbb99f51e0307092f6e1b10badcafec1dc5ed17f not found: ID does not exist"
Sep 11 19:51:34.776709 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.776676    2562 scope.go:117] "RemoveContainer" containerID="733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"
Sep 11 19:51:34.776921 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:51:34.776902    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c\": container with ID starting with 733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c not found: ID does not exist" containerID="733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"
Sep 11 19:51:34.776977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.776930    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c"} err="failed to get container status \"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c\": rpc error: code = NotFound desc = could not find container \"733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c\": container with ID starting with 733272dde10e8dc39fd9ec3cc79296fc48d6053904eb2b601f96387d8768ca3c not found: ID does not exist"
Sep 11 19:51:34.781323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.781302    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:51:34.786632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:34.786605    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-19859a-openshift-default-76fd9fcbb6-l97kc"]
Sep 11 19:51:35.978914 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:35.978883    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" path="/var/lib/kubelet/pods/eb4bfec5-e34b-4b07-a1a0-2d093b7b6275/volumes"
Sep 11 19:51:43.202927 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:43.202892    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:51:50.907035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:50.906995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:51:58.296141 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:51:58.296108    2562 scope.go:117] "RemoveContainer" containerID="9fd706989a721240a8dcb84ef8165af5a2d29eb9a9b723281beebda0020e52be"
Sep 11 19:52:58.119740 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:52:58.119709    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:52:58.121799 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:52:58.121776    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:53:13.205927 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:53:13.205894    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:53:36.502335 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:53:36.502299    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:53:44.603502 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:53:44.603461    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:53:52.115817 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:53:52.115737    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:54:00.305233 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:00.305191    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:54:15.305678 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:15.305640    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:54:23.199632 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:23.199590    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:54:30.180732 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.180695    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:54:30.181220 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.180954    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" podUID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" containerName="manager" containerID="cri-o://2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e" gracePeriod=10
Sep 11 19:54:30.442194 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.442128    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:54:30.546654 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.546618    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ndccv\" (UniqueName: \"kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv\") pod \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") "
Sep 11 19:54:30.546841 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.546715    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume\") pod \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\" (UID: \"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63\") "
Sep 11 19:54:30.547114 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.547090    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" (UID: "09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:54:30.548775 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.548753    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv" (OuterVolumeSpecName: "kube-api-access-ndccv") pod "09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" (UID: "09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63"). InnerVolumeSpecName "kube-api-access-ndccv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:54:30.627626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.627589    2562 generic.go:356] "Generic (PLEG): container finished" podID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" containerID="2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e" exitCode=0
Sep 11 19:54:30.627802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.627631    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"
Sep 11 19:54:30.627802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.627635    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" event={"ID":"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63","Type":"ContainerDied","Data":"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"}
Sep 11 19:54:30.627802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.627749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d" event={"ID":"09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63","Type":"ContainerDied","Data":"65b8ad29f9e9b44a1939e064c9d3bae836aa3eb995ff2d237490bcb180f37eb0"}
Sep 11 19:54:30.627802 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.627792    2562 scope.go:117] "RemoveContainer" containerID="2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"
Sep 11 19:54:30.636972 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.636955    2562 scope.go:117] "RemoveContainer" containerID="2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"
Sep 11 19:54:30.637240 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:54:30.637218    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e\": container with ID starting with 2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e not found: ID does not exist" containerID="2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"
Sep 11 19:54:30.637305 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.637249    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e"} err="failed to get container status \"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e\": rpc error: code = NotFound desc = could not find container \"2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e\": container with ID starting with 2dbcac789ea7f5b554a1c7d4c75cad5ef7d2571d61f0d74e244ba75f658aaf5e not found: ID does not exist"
Sep 11 19:54:30.647512 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.647490    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ndccv\" (UniqueName: \"kubernetes.io/projected/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-kube-api-access-ndccv\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:54:30.647606 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.647512    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63-extensions-socket-volume\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:54:30.651238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.651212    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:54:30.655266 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:30.655243    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-wpm6d"]
Sep 11 19:54:31.978093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:54:31.978052    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" path="/var/lib/kubelet/pods/09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63/volumes"
Sep 11 19:55:50.555638 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:55:50.555558    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:55:57.217983 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:55:57.217945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:56:06.198491 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:06.198457    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:56:19.504035 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504000    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504362    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5b5abf1-b9e9-4826-977f-576887b27096" containerName="main"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504372    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5b5abf1-b9e9-4826-977f-576887b27096" containerName="main"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504385    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" containerName="manager"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504391    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" containerName="manager"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504399    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504405    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504414    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504419    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504429    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504435    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504441    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" containerName="maas-api"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504446    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" containerName="maas-api"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504456    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504461    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504516    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504523    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb4bfec5-e34b-4b07-a1a0-2d093b7b6275" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504529    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="09d9b9a2-252a-4b91-b34a-7ed0fa5f1e63" containerName="manager"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504535    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504574    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="65144a53-f0ba-4ffb-aaef-d1420003d6cf" containerName="maas-api"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504585    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5b5abf1-b9e9-4826-977f-576887b27096" containerName="main"
Sep 11 19:56:19.504595 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.504595    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:19.507665 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.507645    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.510063 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.510039    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e2714fe9-kserve-self-signed-certs\""
Sep 11 19:56:19.517077 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.517051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:56:19.595010 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.594971    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.595187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.595017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.595187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.595128    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.595187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.595164    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgvjf\" (UniqueName: \"kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.595308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.595219    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.595308 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.595247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696172    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696213    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696266    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696293    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgvjf\" (UniqueName: \"kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696458 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696431    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696691 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696478    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696749 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696686    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696821 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696793    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.696941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.696824    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.698587 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.698532    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.698749 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.698732    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.703583 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.703561    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgvjf\" (UniqueName: \"kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf\") pod \"e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") " pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:19.818285 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:19.818185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:20.089053 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:20.089029    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:56:20.091539 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:56:20.091501    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1f2627a_6dcb_44b7_b6b0_ce7405c28fee.slice/crio-56f77f0bfb7fa40c05c0156d1c79c2e459da683260736f070efec9c386d9925b WatchSource:0}: Error finding container 56f77f0bfb7fa40c05c0156d1c79c2e459da683260736f070efec9c386d9925b: Status 404 returned error can't find the container with id 56f77f0bfb7fa40c05c0156d1c79c2e459da683260736f070efec9c386d9925b
Sep 11 19:56:20.154628 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:20.154594    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" event={"ID":"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee","Type":"ContainerStarted","Data":"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"}
Sep 11 19:56:20.154763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:20.154642    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" event={"ID":"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee","Type":"ContainerStarted","Data":"56f77f0bfb7fa40c05c0156d1c79c2e459da683260736f070efec9c386d9925b"}
Sep 11 19:56:20.171317 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:20.171256    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" podStartSLOduration=1.17123325 podStartE2EDuration="1.17123325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:56:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:56:20.170781814 +0000 UTC m=+2302.703837962" watchObservedRunningTime="2026-09-11 19:56:20.17123325 +0000 UTC m=+2302.704289372"
Sep 11 19:56:21.915758 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:21.915716    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:56:29.818962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:29.818918    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:29.818962 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:29.818969    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:29.831728 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:29.831693    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:30.216686 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:30.216650    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:56:34.404228 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.404194    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:56:34.404865 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.404840    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:34.404975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.404867    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:34.404975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.404913    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:34.404975 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.404923    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:34.405127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.405010    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="07d238fe-5493-43f8-836a-5028328d824c" containerName="istio-proxy"
Sep 11 19:56:34.405127 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.405027    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5591dc6e-0df0-4804-9341-a050cf7536db" containerName="istio-proxy"
Sep 11 19:56:34.408179 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.408158    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.410904 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.410877    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e2714fe9-kserve-self-signed-certs\""
Sep 11 19:56:34.416814 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.416722    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:56:34.431215 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.431348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431307    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74m5p\" (UniqueName: \"kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.431348 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431337    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.431426 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431376    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.431462 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431438    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.431497 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.431463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532470 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532525    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532622    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74m5p\" (UniqueName: \"kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532648    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532763 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532683    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532843    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.532994 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.532896    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.533093 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.533019    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.534902 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.534873    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.535103 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.535086    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.540525 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.540499    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74m5p\" (UniqueName: \"kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p\") pod \"e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") " pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.719445 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.719346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:34.991825 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:34.991795    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:56:34.993910 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:56:34.993885    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9711e3e5_71cb_4854_bdb3_d3f487fa7b39.slice/crio-51c625bbe2fa3d195c05f9c0935a67e8e44720bb5eb7eb4632e30f911f89f6fc WatchSource:0}: Error finding container 51c625bbe2fa3d195c05f9c0935a67e8e44720bb5eb7eb4632e30f911f89f6fc: Status 404 returned error can't find the container with id 51c625bbe2fa3d195c05f9c0935a67e8e44720bb5eb7eb4632e30f911f89f6fc
Sep 11 19:56:35.230832 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:35.230793    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" event={"ID":"9711e3e5-71cb-4854-bdb3-d3f487fa7b39","Type":"ContainerStarted","Data":"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"}
Sep 11 19:56:35.231049 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:35.230844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" event={"ID":"9711e3e5-71cb-4854-bdb3-d3f487fa7b39","Type":"ContainerStarted","Data":"51c625bbe2fa3d195c05f9c0935a67e8e44720bb5eb7eb4632e30f911f89f6fc"}
Sep 11 19:56:35.247764 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:35.247662    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" podStartSLOduration=1.247633853 podStartE2EDuration="1.247633853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:56:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:56:35.246602786 +0000 UTC m=+2317.779658924" watchObservedRunningTime="2026-09-11 19:56:35.247633853 +0000 UTC m=+2317.780689974"
Sep 11 19:56:37.405146 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:37.405111    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:56:44.719900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:44.719853    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:44.719900 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:44.719911    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:44.732626 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:44.732597    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:56:45.292932 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:56:45.292897    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:57:04.374229 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:04.374192    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:57:05.979448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:05.979412    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:57:06.519843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:06.519804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:15.503037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:15.502991    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:19.393853 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.393783    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" podUID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" containerName="main" containerID="cri-o://7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519" gracePeriod=45
Sep 11 19:57:19.650293 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.650234    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:57:19.757838 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.757797    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgvjf\" (UniqueName: \"kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.757874    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.757901    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.757957    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.757996    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.758040    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs\") pod \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\" (UID: \"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee\") "
Sep 11 19:57:19.758304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.758190    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home" (OuterVolumeSpecName: "home") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:19.758304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.758269    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:19.758304 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.758302    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-home\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:19.758529 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.758325    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache" (OuterVolumeSpecName: "model-cache") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:19.760214 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.760186    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf" (OuterVolumeSpecName: "kube-api-access-qgvjf") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "kube-api-access-qgvjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:57:19.760323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.760232    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm" (OuterVolumeSpecName: "dshm") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:19.760323 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.760282    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" (UID: "f1f2627a-6dcb-44b7-b6b0-ce7405c28fee"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:19.859014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.858977    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tmp-dir\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:19.859014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.859007    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-model-cache\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:19.859014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.859017    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-dshm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:19.859014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.859025    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-tls-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:19.859287 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:19.859035    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgvjf\" (UniqueName: \"kubernetes.io/projected/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee-kube-api-access-qgvjf\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:20.458561 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.458505    2562 generic.go:356] "Generic (PLEG): container finished" podID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" containerID="7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519" exitCode=0
Sep 11 19:57:20.458977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.458577    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"
Sep 11 19:57:20.458977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.458603    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" event={"ID":"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee","Type":"ContainerDied","Data":"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"}
Sep 11 19:57:20.458977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.458648    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr" event={"ID":"f1f2627a-6dcb-44b7-b6b0-ce7405c28fee","Type":"ContainerDied","Data":"56f77f0bfb7fa40c05c0156d1c79c2e459da683260736f070efec9c386d9925b"}
Sep 11 19:57:20.458977 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.458666    2562 scope.go:117] "RemoveContainer" containerID="7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"
Sep 11 19:57:20.474154 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.474119    2562 scope.go:117] "RemoveContainer" containerID="7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"
Sep 11 19:57:20.474980 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:57:20.474941    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519\": container with ID starting with 7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519 not found: ID does not exist" containerID="7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"
Sep 11 19:57:20.475183 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.475147    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519"} err="failed to get container status \"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519\": rpc error: code = NotFound desc = could not find container \"7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519\": container with ID starting with 7f00f439a194b4fd047a3e60bf175b9ad0b28b1f532166f772c3a0be6b577519 not found: ID does not exist"
Sep 11 19:57:20.477168 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.477148    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:57:20.480345 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.480322    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e2714fe9-kserve-6c9bf6d66c-9ffxr"]
Sep 11 19:57:20.998178 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:20.998135    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" podUID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" containerName="main" containerID="cri-o://9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7" gracePeriod=45
Sep 11 19:57:21.261610 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.261536    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:57:21.375363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375317    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375363 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375370    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375667 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375404    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375667 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375457    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375678    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74m5p\" (UniqueName: \"kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375708    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:21.375779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375735    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache" (OuterVolumeSpecName: "model-cache") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:21.375779 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375776    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home\") pod \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\" (UID: \"9711e3e5-71cb-4854-bdb3-d3f487fa7b39\") "
Sep 11 19:57:21.375971 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.375949    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home" (OuterVolumeSpecName: "home") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:21.376062 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.376049    2562 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-model-cache\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.376105 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.376066    2562 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tmp-dir\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.376105 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.376075    2562 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-home\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.377747 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.377728    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p" (OuterVolumeSpecName: "kube-api-access-74m5p") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "kube-api-access-74m5p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:57:21.378037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.378012    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm" (OuterVolumeSpecName: "dshm") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 19:57:21.378137 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.378014    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9711e3e5-71cb-4854-bdb3-d3f487fa7b39" (UID: "9711e3e5-71cb-4854-bdb3-d3f487fa7b39"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:21.465395 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.465358    2562 generic.go:356] "Generic (PLEG): container finished" podID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" containerID="9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7" exitCode=0
Sep 11 19:57:21.465843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.465400    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"
Sep 11 19:57:21.465843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.465435    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" event={"ID":"9711e3e5-71cb-4854-bdb3-d3f487fa7b39","Type":"ContainerDied","Data":"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"}
Sep 11 19:57:21.465843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.465477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz" event={"ID":"9711e3e5-71cb-4854-bdb3-d3f487fa7b39","Type":"ContainerDied","Data":"51c625bbe2fa3d195c05f9c0935a67e8e44720bb5eb7eb4632e30f911f89f6fc"}
Sep 11 19:57:21.465843 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.465493    2562 scope.go:117] "RemoveContainer" containerID="9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"
Sep 11 19:57:21.475392 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.475367    2562 scope.go:117] "RemoveContainer" containerID="9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"
Sep 11 19:57:21.475692 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:57:21.475674    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7\": container with ID starting with 9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7 not found: ID does not exist" containerID="9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"
Sep 11 19:57:21.475754 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.475701    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7"} err="failed to get container status \"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7\": rpc error: code = NotFound desc = could not find container \"9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7\": container with ID starting with 9282e3acf421ef9cd3cae2979fc8afa2dba5f484d26d92ee9bc3c69683e976d7 not found: ID does not exist"
Sep 11 19:57:21.477144 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.477128    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74m5p\" (UniqueName: \"kubernetes.io/projected/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-kube-api-access-74m5p\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.477197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.477147    2562 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-dshm\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.477197 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.477158    2562 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9711e3e5-71cb-4854-bdb3-d3f487fa7b39-tls-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:21.486608 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.486583    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:57:21.490013 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.489989    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e2714fe9-kserve-755c465d87-k9qnz"]
Sep 11 19:57:21.979494 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.979451    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" path="/var/lib/kubelet/pods/9711e3e5-71cb-4854-bdb3-d3f487fa7b39/volumes"
Sep 11 19:57:21.979970 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:21.979947    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" path="/var/lib/kubelet/pods/f1f2627a-6dcb-44b7-b6b0-ce7405c28fee/volumes"
Sep 11 19:57:24.708997 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.708958    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:24.900858 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.900823    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:24.901201 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901189    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" containerName="main"
Sep 11 19:57:24.901245 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901203    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" containerName="main"
Sep 11 19:57:24.901245 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901226    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" containerName="main"
Sep 11 19:57:24.901245 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901232    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" containerName="main"
Sep 11 19:57:24.901347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901294    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1f2627a-6dcb-44b7-b6b0-ce7405c28fee" containerName="main"
Sep 11 19:57:24.901347 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.901300    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9711e3e5-71cb-4854-bdb3-d3f487fa7b39" containerName="main"
Sep 11 19:57:24.905753 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.905735    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:24.909299 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.909271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 19:57:24.909299 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.909290    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 19:57:24.909492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.909301    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-5hbtr\""
Sep 11 19:57:24.909492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.909271    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 19:57:24.909492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.909271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 19:57:24.914601 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.914580    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:24.917018 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.916994    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8957965-h5c89"]
Sep 11 19:57:24.920559 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.920527    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:24.934039 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:24.934012    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8957965-h5c89"]
Sep 11 19:57:25.010275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.010275 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/491635e4-4f33-4bd4-a48c-83a648f9ea50-openshift-service-ca\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.010477 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbtd7\" (UniqueName: \"kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.010477 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010443    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-maas-api-tls\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.010477 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsd67\" (UniqueName: \"kubernetes.io/projected/491635e4-4f33-4bd4-a48c-83a648f9ea50-kube-api-access-wsd67\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.010657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.010657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010598    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-metrics-certs\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.010657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.010647    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.111533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111490    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-metrics-certs\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.111761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111581    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.111761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111631    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.111761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111667    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/491635e4-4f33-4bd4-a48c-83a648f9ea50-openshift-service-ca\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.111761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbtd7\" (UniqueName: \"kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.111761 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111734    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-maas-api-tls\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.112053 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111773    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsd67\" (UniqueName: \"kubernetes.io/projected/491635e4-4f33-4bd4-a48c-83a648f9ea50-kube-api-access-wsd67\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.112053 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.111867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.112484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.112453    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.113439 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.113405    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/491635e4-4f33-4bd4-a48c-83a648f9ea50-openshift-service-ca\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.114454 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.114430    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-metrics-certs\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.114637 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.114615    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.115024 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.114998    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/491635e4-4f33-4bd4-a48c-83a648f9ea50-maas-api-tls\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.115097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.115078    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.119774 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.119748    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbtd7\" (UniqueName: \"kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7\") pod \"maas-api-f476c4797-m55bw\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") " pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.119885 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.119866    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsd67\" (UniqueName: \"kubernetes.io/projected/491635e4-4f33-4bd4-a48c-83a648f9ea50-kube-api-access-wsd67\") pod \"maas-api-6db8957965-h5c89\" (UID: \"491635e4-4f33-4bd4-a48c-83a648f9ea50\") " pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.217400 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.217359    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:25.234385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.234360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:25.499168 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.499142    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:25.501439 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:57:25.501399    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5efda77a_858a_49a1_bfb2_babea82b038e.slice/crio-94c11d93d143fd1d966a10b40a9488a2433bbd05496cdad4a7e1af6f80a3f198 WatchSource:0}: Error finding container 94c11d93d143fd1d966a10b40a9488a2433bbd05496cdad4a7e1af6f80a3f198: Status 404 returned error can't find the container with id 94c11d93d143fd1d966a10b40a9488a2433bbd05496cdad4a7e1af6f80a3f198
Sep 11 19:57:25.502906 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.502886    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 19:57:25.520092 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:25.520071    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6db8957965-h5c89"]
Sep 11 19:57:25.521840 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:57:25.521816    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod491635e4_4f33_4bd4_a48c_83a648f9ea50.slice/crio-4a957cb1858d08a88afe644fcbbf38e0b9aa7c13bb4d64a57f2db709390f75af WatchSource:0}: Error finding container 4a957cb1858d08a88afe644fcbbf38e0b9aa7c13bb4d64a57f2db709390f75af: Status 404 returned error can't find the container with id 4a957cb1858d08a88afe644fcbbf38e0b9aa7c13bb4d64a57f2db709390f75af
Sep 11 19:57:26.498187 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.498145    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89" event={"ID":"491635e4-4f33-4bd4-a48c-83a648f9ea50","Type":"ContainerStarted","Data":"bd5417de3805b2518541c058912248e790e4cb965aa757a1deebdc49f0573f37"}
Sep 11 19:57:26.498636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.498210    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89" event={"ID":"491635e4-4f33-4bd4-a48c-83a648f9ea50","Type":"ContainerStarted","Data":"4a957cb1858d08a88afe644fcbbf38e0b9aa7c13bb4d64a57f2db709390f75af"}
Sep 11 19:57:26.498636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.498324    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:26.499767 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.499742    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" event={"ID":"5efda77a-858a-49a1-bfb2-babea82b038e","Type":"ContainerStarted","Data":"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"}
Sep 11 19:57:26.499871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.499783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" event={"ID":"5efda77a-858a-49a1-bfb2-babea82b038e","Type":"ContainerStarted","Data":"94c11d93d143fd1d966a10b40a9488a2433bbd05496cdad4a7e1af6f80a3f198"}
Sep 11 19:57:26.499871 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.499805    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:26.522238 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.522179    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89" podStartSLOduration=2.073399168 podStartE2EDuration="2.522162835s" totalImagesPullingTime="448.763667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:57:26.521061802 +0000 UTC m=+2369.054117933" watchObservedRunningTime="2026-09-11 19:57:26.522162835 +0000 UTC m=+2369.055218955"
Sep 11 19:57:26.537384 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:26.537333    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" podStartSLOduration=2.043698912 podStartE2EDuration="2.537312554s" totalImagesPullingTime="493.613642ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 19:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:57:26.537241382 +0000 UTC m=+2369.070297522" watchObservedRunningTime="2026-09-11 19:57:26.537312554 +0000 UTC m=+2369.070368675"
Sep 11 19:57:32.210613 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.210574    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:32.511284 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.511196    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:32.511636 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.511613    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6db8957965-h5c89"
Sep 11 19:57:32.576096 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.576060    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:32.576309 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.576264    2562 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" podUID="5efda77a-858a-49a1-bfb2-babea82b038e" containerName="maas-api" containerID="cri-o://0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227" gracePeriod=30
Sep 11 19:57:32.830845 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.830813    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:32.887984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.887940    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca\") pod \"5efda77a-858a-49a1-bfb2-babea82b038e\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") "
Sep 11 19:57:32.887984 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.887987    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbtd7\" (UniqueName: \"kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7\") pod \"5efda77a-858a-49a1-bfb2-babea82b038e\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") "
Sep 11 19:57:32.888247 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.888037    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs\") pod \"5efda77a-858a-49a1-bfb2-babea82b038e\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") "
Sep 11 19:57:32.888247 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.888138    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls\") pod \"5efda77a-858a-49a1-bfb2-babea82b038e\" (UID: \"5efda77a-858a-49a1-bfb2-babea82b038e\") "
Sep 11 19:57:32.888362 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.888321    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5efda77a-858a-49a1-bfb2-babea82b038e" (UID: "5efda77a-858a-49a1-bfb2-babea82b038e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 19:57:32.888475 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.888448    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5efda77a-858a-49a1-bfb2-babea82b038e-openshift-service-ca\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:32.890257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.890225    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7" (OuterVolumeSpecName: "kube-api-access-vbtd7") pod "5efda77a-858a-49a1-bfb2-babea82b038e" (UID: "5efda77a-858a-49a1-bfb2-babea82b038e"). InnerVolumeSpecName "kube-api-access-vbtd7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 19:57:32.890257 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.890250    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5efda77a-858a-49a1-bfb2-babea82b038e" (UID: "5efda77a-858a-49a1-bfb2-babea82b038e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:32.890385 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.890234    2562 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "5efda77a-858a-49a1-bfb2-babea82b038e" (UID: "5efda77a-858a-49a1-bfb2-babea82b038e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 19:57:32.989419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.989368    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbtd7\" (UniqueName: \"kubernetes.io/projected/5efda77a-858a-49a1-bfb2-babea82b038e-kube-api-access-vbtd7\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:32.989419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.989412    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-metrics-certs\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:32.989419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:32.989422    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5efda77a-858a-49a1-bfb2-babea82b038e-maas-api-tls\") on node \"ip-10-0-141-0.ec2.internal\" DevicePath \"\""
Sep 11 19:57:33.536853 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.536820    2562 generic.go:356] "Generic (PLEG): container finished" podID="5efda77a-858a-49a1-bfb2-babea82b038e" containerID="0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227" exitCode=0
Sep 11 19:57:33.537298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.536866    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw"
Sep 11 19:57:33.537298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.536901    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" event={"ID":"5efda77a-858a-49a1-bfb2-babea82b038e","Type":"ContainerDied","Data":"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"}
Sep 11 19:57:33.537298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.536954    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f476c4797-m55bw" event={"ID":"5efda77a-858a-49a1-bfb2-babea82b038e","Type":"ContainerDied","Data":"94c11d93d143fd1d966a10b40a9488a2433bbd05496cdad4a7e1af6f80a3f198"}
Sep 11 19:57:33.537298 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.536977    2562 scope.go:117] "RemoveContainer" containerID="0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"
Sep 11 19:57:33.546420 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.546398    2562 scope.go:117] "RemoveContainer" containerID="0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"
Sep 11 19:57:33.546727 ip-10-0-141-0 kubenswrapper[2562]: E0911 19:57:33.546705    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227\": container with ID starting with 0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227 not found: ID does not exist" containerID="0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"
Sep 11 19:57:33.546825 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.546740    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227"} err="failed to get container status \"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227\": rpc error: code = NotFound desc = could not find container \"0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227\": container with ID starting with 0acc8ef4ae02429ee48d475acd2a20ef6888d36b55819bfc0a8d39c44b225227 not found: ID does not exist"
Sep 11 19:57:33.558273 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.558249    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:33.561727 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.561701    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f476c4797-m55bw"]
Sep 11 19:57:33.978535 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:33.978502    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5efda77a-858a-49a1-bfb2-babea82b038e" path="/var/lib/kubelet/pods/5efda77a-858a-49a1-bfb2-babea82b038e/volumes"
Sep 11 19:57:39.595267 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:39.595232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:47.903634 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:47.903589    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:55.224014 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:55.223976    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-vv9zm"]
Sep 11 19:57:58.151730 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:58.151697    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:57:58.154928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:58.154899    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:57:58.689484 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:57:58.689453    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cc8d7bd7d-hk578_1dbefefc-e2a4-46a1-b2c7-eedc93493f42/authorino/0.log"
Sep 11 19:58:03.799229 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:03.799198    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fhjff_5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98/manager/0.log"
Sep 11 19:58:03.914652 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:03.914621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wksv4_409656b0-b5e9-479b-8532-241fd96dbbf0/manager/0.log"
Sep 11 19:58:04.496041 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:04.496012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-cdwcx_98289b56-4226-41fd-a0ee-06616391e13e/copy-manifests/0.log"
Sep 11 19:58:04.507846 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:04.507814    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-cdwcx_98289b56-4226-41fd-a0ee-06616391e13e/manager/0.log"
Sep 11 19:58:05.075091 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:05.075061    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-6db8957965-h5c89_491635e4-4f33-4bd4-a48c-83a648f9ea50/maas-api/0.log"
Sep 11 19:58:06.145703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:06.145676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cc8d7bd7d-hk578_1dbefefc-e2a4-46a1-b2c7-eedc93493f42/authorino/0.log"
Sep 11 19:58:06.250720 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:06.250684    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-vsdh6_deebe44a-eea2-4353-bd6a-03e9cf22368e/manager/0.log"
Sep 11 19:58:06.360448 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:06.360421    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ldmm5_cd845113-ea4e-4423-8123-542fdcd9672d/manager/0.log"
Sep 11 19:58:06.690715 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:06.690682    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vv9zm_47328f6b-8949-47d2-83fd-7e810dd818b5/limitador/0.log"
Sep 11 19:58:06.804938 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:06.804904    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ct85m_19f6bdd1-7a37-4959-bc8d-7afbf8af98c3/manager/0.log"
Sep 11 19:58:07.372941 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:07.372911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57c686645c-74fbr_6406b6e0-b73f-4f36-9d99-cc65139ec037/kube-auth-proxy/0.log"
Sep 11 19:58:07.932585 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:07.932554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5844c87d68-m7h5f_e7bc7717-75c3-4536-80b3-5e65e41f2fb7/router/0.log"
Sep 11 19:58:08.263082 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:08.262997    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vb896_2d7b580d-0125-4d34-9146-c62749760b8e/main/0.log"
Sep 11 19:58:08.481017 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:08.480986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-9jttz_fe704084-61ff-46bd-9c22-fc58fb027dc5/main/0.log"
Sep 11 19:58:08.800524 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:08.800492    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-vclkd_a98c764f-ea4e-4bb3-be3d-b3461e98b221/main/0.log"
Sep 11 19:58:17.683928 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:17.683894    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j2gh7_a9c3801b-0d71-4655-a745-d78065b1377f/global-pull-secret-syncer/0.log"
Sep 11 19:58:17.798419 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:17.798384    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f65bd_23640b3d-6229-4075-b5ad-70f60d7b6a31/konnectivity-agent/0.log"
Sep 11 19:58:17.908688 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:17.908657    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-0.ec2.internal_6c4cdcfdb8bdbbc4a8ed511bbe2ee055/haproxy/0.log"
Sep 11 19:58:22.455012 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:22.454978    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6cc8d7bd7d-hk578_1dbefefc-e2a4-46a1-b2c7-eedc93493f42/authorino/0.log"
Sep 11 19:58:22.488743 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:22.488714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-vsdh6_deebe44a-eea2-4353-bd6a-03e9cf22368e/manager/0.log"
Sep 11 19:58:22.516627 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:22.516597    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-ldmm5_cd845113-ea4e-4423-8123-542fdcd9672d/manager/0.log"
Sep 11 19:58:22.627829 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:22.627803    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-vv9zm_47328f6b-8949-47d2-83fd-7e810dd818b5/limitador/0.log"
Sep 11 19:58:22.687256 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:22.687172    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-ct85m_19f6bdd1-7a37-4959-bc8d-7afbf8af98c3/manager/0.log"
Sep 11 19:58:24.226945 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:24.226911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cd954b897-w8f4m_a64daf77-c537-4f55-a39b-4fd39746000c/cluster-monitoring-operator/0.log"
Sep 11 19:58:24.530057 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:24.529975    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5m5v_b870ff00-792c-4b52-9432-d3f7b32a6a7e/node-exporter/0.log"
Sep 11 19:58:24.551658 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:24.551629    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5m5v_b870ff00-792c-4b52-9432-d3f7b32a6a7e/kube-rbac-proxy/0.log"
Sep 11 19:58:24.574024 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:24.573998    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m5m5v_b870ff00-792c-4b52-9432-d3f7b32a6a7e/init-textfile/0.log"
Sep 11 19:58:24.935005 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:24.934976    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-kkckg_1149e940-772d-4b80-8323-095b402d54e0/prometheus-operator-admission-webhook/0.log"
Sep 11 19:58:26.725232 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:26.725200    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-5dcbc7df6b-79frs_20e4aea2-7d0f-4280-9f21-f476cdf933f0/networking-console-plugin/0.log"
Sep 11 19:58:27.345559 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:27.345527    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/1.log"
Sep 11 19:58:27.349795 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:27.349769    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-696884fb9c-c5bf9_3da161bf-30d4-447b-a4fe-c8242dbe9e1f/console-operator/2.log"
Sep 11 19:58:28.316209 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.316173    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"]
Sep 11 19:58:28.316622 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.316535    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5efda77a-858a-49a1-bfb2-babea82b038e" containerName="maas-api"
Sep 11 19:58:28.316622 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.316559    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5efda77a-858a-49a1-bfb2-babea82b038e" containerName="maas-api"
Sep 11 19:58:28.316703 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.316670    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5efda77a-858a-49a1-bfb2-babea82b038e" containerName="maas-api"
Sep 11 19:58:28.319950 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.319929    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.322767 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.322742    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4pg49\"/\"default-dockercfg-nxwjj\""
Sep 11 19:58:28.322888 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.322751    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4pg49\"/\"kube-root-ca.crt\""
Sep 11 19:58:28.323564 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.323535    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4pg49\"/\"openshift-service-ca.crt\""
Sep 11 19:58:28.330826 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.330804    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"]
Sep 11 19:58:28.500917 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.500881    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-lib-modules\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.501097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.500930    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-podres\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.501097 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.501031    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5b75\" (UniqueName: \"kubernetes.io/projected/d13030c3-7312-4d24-a712-ceef249062ce-kube-api-access-s5b75\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.501178 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.501100    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-sys\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.501178 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.501122    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-proc\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601684 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601643    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-lib-modules\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601718    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-podres\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601785    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5b75\" (UniqueName: \"kubernetes.io/projected/d13030c3-7312-4d24-a712-ceef249062ce-kube-api-access-s5b75\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601834    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-sys\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601844    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-lib-modules\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601858    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-podres\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.601895 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601855    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-proc\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.602163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601912    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-sys\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.602163 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.601956    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d13030c3-7312-4d24-a712-ceef249062ce-proc\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.610886 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.610859    2562 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5b75\" (UniqueName: \"kubernetes.io/projected/d13030c3-7312-4d24-a712-ceef249062ce-kube-api-access-s5b75\") pod \"perf-node-gather-daemonset-5tgr8\" (UID: \"d13030c3-7312-4d24-a712-ceef249062ce\") " pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.630036 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.630014    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:28.777181 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.777149    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-86695b7cc7-5nbwr_347de126-fe77-4fd7-8c67-b6472814cc4e/volume-data-source-validator/0.log"
Sep 11 19:58:28.900536 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:28.900463    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"]
Sep 11 19:58:28.903738 ip-10-0-141-0 kubenswrapper[2562]: W0911 19:58:28.903708    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd13030c3_7312_4d24_a712_ceef249062ce.slice/crio-2f13f1a01fb47d0cbdcbaf7865a0d1b3447659e065a22be9074362674f932a32 WatchSource:0}: Error finding container 2f13f1a01fb47d0cbdcbaf7865a0d1b3447659e065a22be9074362674f932a32: Status 404 returned error can't find the container with id 2f13f1a01fb47d0cbdcbaf7865a0d1b3447659e065a22be9074362674f932a32
Sep 11 19:58:29.821060 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:29.821023    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8" event={"ID":"d13030c3-7312-4d24-a712-ceef249062ce","Type":"ContainerStarted","Data":"a15e91fb14a1270961cb321fad4551791a8a7083351f0d0d08f96473b06100af"}
Sep 11 19:58:29.821533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:29.821074    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8" event={"ID":"d13030c3-7312-4d24-a712-ceef249062ce","Type":"ContainerStarted","Data":"2f13f1a01fb47d0cbdcbaf7865a0d1b3447659e065a22be9074362674f932a32"}
Sep 11 19:58:29.821533 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:29.821097    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:29.837409 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:29.837356    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8" podStartSLOduration=1.837339327 podStartE2EDuration="1.837339327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 19:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 19:58:29.836217295 +0000 UTC m=+2432.369273449" watchObservedRunningTime="2026-09-11 19:58:29.837339327 +0000 UTC m=+2432.370395448"
Sep 11 19:58:29.999327 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:29.999295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6959_7c90ab68-9b10-49fb-a663-11a1f424a479/dns/0.log"
Sep 11 19:58:30.017259 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:30.017223    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z6959_7c90ab68-9b10-49fb-a663-11a1f424a479/kube-rbac-proxy/0.log"
Sep 11 19:58:30.038492 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:30.038457    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5m9j9_6e232b6a-9ed7-4fe8-bc3b-75f2cf11cb36/dns-node-resolver/0.log"
Sep 11 19:58:30.691649 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:30.691615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-g85c6_74166b65-c6a3-4163-9c57-ca19bbf3fcb9/node-ca/0.log"
Sep 11 19:58:32.420866 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:32.420836    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57c686645c-74fbr_6406b6e0-b73f-4f36-9d99-cc65139ec037/kube-auth-proxy/0.log"
Sep 11 19:58:32.568364 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:32.568328    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5844c87d68-m7h5f_e7bc7717-75c3-4536-80b3-5e65e41f2fb7/router/0.log"
Sep 11 19:58:33.419025 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:33.418994    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-d52s8_3bf51b14-c5b9-461a-b6b4-bb0992307c37/serve-healthcheck-canary/0.log"
Sep 11 19:58:33.914913 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:33.914865    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-dlv9b_6f8197fa-426d-48b8-a5ae-c5fd43c79714/insights-operator/0.log"
Sep 11 19:58:33.915657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:33.915631    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5844b856db-dlv9b_6f8197fa-426d-48b8-a5ae-c5fd43c79714/insights-operator/1.log"
Sep 11 19:58:34.003657 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:34.003590    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnvt9_c3654226-a98e-4076-b720-df90568cd35e/kube-rbac-proxy/0.log"
Sep 11 19:58:34.022287 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:34.022262    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnvt9_c3654226-a98e-4076-b720-df90568cd35e/exporter/0.log"
Sep 11 19:58:34.042037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:34.041986    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nnvt9_c3654226-a98e-4076-b720-df90568cd35e/extractor/0.log"
Sep 11 19:58:35.836412 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:35.836383    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4pg49/perf-node-gather-daemonset-5tgr8"
Sep 11 19:58:36.186421 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:36.186317    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-fhjff_5ee92fbc-01e7-4f9b-bb59-1e8b7abdeb98/manager/0.log"
Sep 11 19:58:36.415045 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:36.414985    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-wksv4_409656b0-b5e9-479b-8532-241fd96dbbf0/manager/0.log"
Sep 11 19:58:36.740037 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:36.739982    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-cdwcx_98289b56-4226-41fd-a0ee-06616391e13e/manager/0.log"
Sep 11 19:58:36.755953 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:36.755925    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6474799d6-cdwcx_98289b56-4226-41fd-a0ee-06616391e13e/copy-manifests/0.log"
Sep 11 19:58:39.387529 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:39.387498    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57c686645c-74fbr_6406b6e0-b73f-4f36-9d99-cc65139ec037/kube-auth-proxy/0.log"
Sep 11 19:58:39.500188 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:39.500159    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5844c87d68-m7h5f_e7bc7717-75c3-4536-80b3-5e65e41f2fb7/router/0.log"
Sep 11 19:58:41.887427 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:41.887394    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-57c686645c-74fbr_6406b6e0-b73f-4f36-9d99-cc65139ec037/kube-auth-proxy/0.log"
Sep 11 19:58:42.013974 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:42.013934    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5844c87d68-m7h5f_e7bc7717-75c3-4536-80b3-5e65e41f2fb7/router/0.log"
Sep 11 19:58:43.810344 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:43.810316    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-mhqfv_99bfb024-cfdc-4e99-8a42-2320482c3f49/migrator/0.log"
Sep 11 19:58:43.827718 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:43.827688    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-mhqfv_99bfb024-cfdc-4e99-8a42-2320482c3f49/graceful-termination/0.log"
Sep 11 19:58:44.171468 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:44.171432    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-lnfsg_41f61dfc-e449-42ea-bfa4-14a6c0c0ebce/kube-storage-version-migrator-operator/1.log"
Sep 11 19:58:44.172106 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:44.172087    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6c8f84f897-lnfsg_41f61dfc-e449-42ea-bfa4-14a6c0c0ebce/kube-storage-version-migrator-operator/0.log"
Sep 11 19:58:45.284000 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.283968    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/kube-multus-additional-cni-plugins/0.log"
Sep 11 19:58:45.303315 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.303286    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/egress-router-binary-copy/0.log"
Sep 11 19:58:45.324126 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.324100    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/cni-plugins/0.log"
Sep 11 19:58:45.344637 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.344615    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/bond-cni-plugin/0.log"
Sep 11 19:58:45.363146 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.363126    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/routeoverride-cni/0.log"
Sep 11 19:58:45.381133 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.381113    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/whereabouts-cni-bincopy/0.log"
Sep 11 19:58:45.398722 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.398704    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wlvf9_bebe2f75-86c3-426b-bc61-3f42723b9093/whereabouts-cni/0.log"
Sep 11 19:58:45.605303 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.605277    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nhn9z_84ce9764-735d-42d2-b705-4acea50831eb/kube-multus/0.log"
Sep 11 19:58:45.713971 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.713947    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tkjf7_b4af5044-6d91-4a9e-980a-07695782c0c3/network-metrics-daemon/0.log"
Sep 11 19:58:45.737264 ip-10-0-141-0 kubenswrapper[2562]: I0911 19:58:45.737243    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tkjf7_b4af5044-6d91-4a9e-980a-07695782c0c3/kube-rbac-proxy/0.log"