Sep 19 04:11:35.959868 ip-10-0-139-253 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 19 04:11:35.959878 ip-10-0-139-253 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 19 04:11:35.959886 ip-10-0-139-253 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 19 04:11:35.960162 ip-10-0-139-253 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 19 04:11:46.071138 ip-10-0-139-253 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 19 04:11:46.071156 ip-10-0-139-253 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 6695f73a1eeb48979bc9643d6263b761 --
Sep 19 04:13:31.353689 ip-10-0-139-253 systemd[1]: Starting Kubernetes Kubelet...
Sep 19 04:13:31.727015 ip-10-0-139-253 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:31.727015 ip-10-0-139-253 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 19 04:13:31.727015 ip-10-0-139-253 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:31.727015 ip-10-0-139-253 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 19 04:13:31.727015 ip-10-0-139-253 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 19 04:13:31.728193 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.728092    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 19 04:13:31.732233 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732211    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.732233 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732232    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.732233 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732237    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732242    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732247    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732251    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732255    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732262    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732267    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732271    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732276    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732280    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732284    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732289    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732293    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732297    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732301    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732305    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732309    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732313    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732320    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.732478 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732325    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732329    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732333    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732338    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732342    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732346    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732371    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732375    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732380    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732384    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732389    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732393    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732398    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732403    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732407    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732416    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732422    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732429    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732434    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.733306 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732440    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732445    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732450    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732454    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732460    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732465    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732470    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732475    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732479    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732483    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732488    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732492    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732497    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732501    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732505    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732511    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732516    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732521    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732525    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732529    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.734244 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732534    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732538    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732543    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732548    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732552    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732557    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732561    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732566    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732573    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732579    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732584    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732589    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732594    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732599    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732604    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732609    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732613    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732618    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732623    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732627    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.735150 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732635    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732639    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732644    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732648    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732653    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732657    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732662    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732667    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732672    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732676    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732681    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732686    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732690    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732694    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732699    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732704    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732708    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732713    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.732717    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734124    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.736218 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734136    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734141    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734146    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734153    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734159    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734164    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734169    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734174    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734179    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734183    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734188    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734193    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734197    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734201    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734206    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734211    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734215    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734220    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734225    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734230    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734235    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.737154 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734239    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734243    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734247    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734251    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734256    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734261    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734265    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734270    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734274    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734279    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734283    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734288    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734292    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734297    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734302    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734311    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734318    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734324    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734329    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.737914 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734334    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734339    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734343    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734368    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734374    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734378    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734382    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734387    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734391    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734395    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734400    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734405    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734409    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734414    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734418    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734423    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734427    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734431    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734436    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.738526 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734440    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734445    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734449    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734454    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734458    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734463    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734467    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734472    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734476    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734484    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734488    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734494    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734498    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734503    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734507    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734512    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734516    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734520    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734529    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734535    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.739055 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734540    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734545    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734550    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734556    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734561    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734565    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734570    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734575    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734580    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734587    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734594    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734598    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734603    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734608    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734612    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734616    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734620    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734626    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.734631    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.739659 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735283    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735292    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735300    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735306    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735312    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735320    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735326    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735331    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735336    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735342    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735367    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735372    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735376    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735381    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735385    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735389    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735394    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735399    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735404    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.740342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735409    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735413    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735418    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735422    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735427    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735431    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735436    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735441    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735448    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735454    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735459    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735464    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735468    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735473    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735477    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735481    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735486    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735490    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735496    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.740918 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735500    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735505    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735509    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735513    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735517    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735522    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735526    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735531    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735535    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735539    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735544    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735549    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735553    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735558    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735562    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735566    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735573    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735577    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735582    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735586    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.741512 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735591    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735595    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735599    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735604    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735608    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735612    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735616    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735621    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735626    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735631    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735635    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735639    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735644    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735649    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735653    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735658    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735662    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735669    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735674    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735678    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.742036 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735683    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735687    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735694    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735698    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735702    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735707    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735711    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735716    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735720    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735724    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735728    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735732    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735736    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735741    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735745    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735749    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735753    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735757    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735760    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735764    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.735768    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.742639 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735886    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735942    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735953    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735960    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735969    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735974    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735982    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735990    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.735995    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736000    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736006    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736012    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736018    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736025    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736030    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736035    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736040    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736045    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736054    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736059    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736064    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736070    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736075    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736082    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 19 04:13:31.743188 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736087    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736093    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736099    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736104    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736109    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736114    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736119    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736124    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736133    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736139    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736144    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736149    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736155    2584 flags.go:64] FLAG: --enable-server="true"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736161    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736169    2584 flags.go:64] FLAG: --event-burst="100"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736174    2584 flags.go:64] FLAG: --event-qps="50"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736179    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736185    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736190    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736197    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736202    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736208    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736213    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736218    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736223    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 19 04:13:31.743869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736228    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736232    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736237    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736242    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736247    2584 flags.go:64] FLAG: --feature-gates=""
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736254    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736259    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736265    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736270    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736275    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736281    2584 flags.go:64] FLAG: --help="false"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736286    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-139-253.ec2.internal"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736291    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736296    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736301    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736310    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736318    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736323    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736328    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736333    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736338    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736344    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736373    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736378    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 19 04:13:31.744609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736384    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736388    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736394    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736398    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736407    2584 flags.go:64] FLAG: --lock-file=""
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736411    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736416    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736421    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736431    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736436    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736441    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736446    2584 flags.go:64] FLAG: --logging-format="text"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736451    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736457    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736462    2584 flags.go:64] FLAG: --manifest-url=""
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736467    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736474    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736479    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736486    2584 flags.go:64] FLAG: --max-pods="110"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736491    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736496    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736501    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736506    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736514    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736519    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 19 04:13:31.745301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736524    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736536    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736542    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736547    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736552    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736558    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:a6abe77af61c5f2e3985a83e7d43538aefc38b1b0444127da14ee0e8cf8f76fc"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736568    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736573    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736578    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736583    2584 flags.go:64] FLAG: --port="10250"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736588    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736593    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0763b4d507c36efcf"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736600    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736606    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736611    2584 flags.go:64] FLAG: --register-node="true"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736616    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736629    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736634    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736639    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736644    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736651    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736656    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736661    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736666    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736671    2584 flags.go:64] FLAG: --runonce="false"
Sep 19 04:13:31.746015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736676    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736682    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736686    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736692    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736698    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736705    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736710    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736715    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736720    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736725    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736730    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736735    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736741    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736747    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736752    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736761    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736766    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736771    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736779    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736785    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736791    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736796    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736801    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736806    2584 flags.go:64] FLAG: --v="2"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736813    2584 flags.go:64] FLAG: --version="false"
Sep 19 04:13:31.746707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736820    2584 flags.go:64] FLAG: --vmodule=""
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736826    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.736832    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737030    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737037    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737043    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737047    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737052    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737056    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737063    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737070    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737075    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737082    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737087    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737092    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737097    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737101    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737106    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737111    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737115    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.747363 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737119    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737126    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737130    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737135    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737139    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737144    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737150    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737155    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737159    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737163    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737167    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737171    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737175    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737180    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737184    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737188    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737193    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737198    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737202    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737207    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.747901 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737212    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737216    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737223    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737229    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737237    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737243    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737247    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737251    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737256    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737260    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737265    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737270    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737275    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737279    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737285    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737289    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737293    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737298    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737303    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.748508 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737307    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737311    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737315    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737320    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737324    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737329    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737333    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737338    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737342    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737366    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737372    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737378    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737384    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737389    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737393    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737397    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737402    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737409    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737413    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737418    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.749008 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737423    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737427    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737431    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737435    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737440    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737445    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737449    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737454    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737459    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737464    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737469    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737473    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737477    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737482    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737486    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737490    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737495    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737499    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737504    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737508    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.749572 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737513    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737517    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.737522    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.738144    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.746420    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.746437    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.747905    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.747913    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747974    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747980    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747984    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747987    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747990    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747994    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.747997    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.750101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748000    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748002    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748005    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748008    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748012    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748015    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748019    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748021    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748025    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748028    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748031    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748034    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748037    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748041    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748046    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748049    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748052    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748055    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748057    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.750516 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748060    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748063    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748066    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748070    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748073    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748077    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748080    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748082    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748085    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748088    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748091    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748093    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748096    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748099    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748101    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748104    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748107    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748109    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748112    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748115    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.751031 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748117    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748120    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748123    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748126    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748128    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748131    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748133    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748136    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748139    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748142    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748144    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748148    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748152    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748155    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748158    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748161    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748165    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748167    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748170    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748173    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.751588 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748175    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748178    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748181    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748184    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748186    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748189    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748192    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748194    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748197    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748200    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748202    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748205    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748208    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748211    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748213    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748216    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748219    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748222    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748226    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748230    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.752095 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748233    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748236    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748239    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748242    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748245    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748248    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748252    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748256    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748259    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748263    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748265    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748268    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748271    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.748277    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748418    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 19 04:13:31.752707 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748424    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748427    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748430    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748433    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748436    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748439    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748442    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748444    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748447    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748450    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748453    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748455    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748458    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748461    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748464    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748467    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748469    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748473    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748477    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 19 04:13:31.753444 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748481    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748484    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748487    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748490    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748493    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748496    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748499    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748502    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748505    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748508    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748511    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748514    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748516    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748519    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748522    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748525    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748528    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748530    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748533    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748535    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 19 04:13:31.754171 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748538    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748540    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748543    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748546    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748548    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748551    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748553    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748556    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748559    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748561    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748564    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748566    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748569    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748572    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748574    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748577    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748579    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748583    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748585    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748588    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 19 04:13:31.754714 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748591    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748595    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748599    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748602    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748605    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748608    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748611    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748614    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748617    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748620    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748622    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748625    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748628    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748630    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748633    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748635    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748638    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748641    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748643    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 19 04:13:31.755282 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748646    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748649    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748651    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748654    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748656    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748659    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748662    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748664    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748667    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748669    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748673    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748676    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748678    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748681    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748685    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748693    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748696    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748699    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748701    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 19 04:13:31.755797 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:31.748704    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.748709    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.748833    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.755152    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.756058    2584 server.go:1019] "Starting client certificate rotation"
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.756164    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 04:13:31.756288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.756198    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 19 04:13:31.758585 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.758566    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 04:13:31.761385 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.761364    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 19 04:13:31.770364 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.770330    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 19 04:13:31.772069 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.772051    2584 log.go:25] "Validated CRI v1 image API"
Sep 19 04:13:31.772991 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.772973    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 19 04:13:31.777531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.777510    2584 fs.go:135] Filesystem UUIDs: map[076c8d54-3baf-47b8-859e-e544b55978f7:/dev/nvme0n1p4 6a10e630-cb10-489a-898e-8c64ef75b9ba:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 19 04:13:31.777608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.777532    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 19 04:13:31.783815 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.783691    2584 manager.go:216] Machine: {Timestamp:2026-09-19 04:13:31.782453029 +0000 UTC m=+0.316434461 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3067405 MemoryCapacity:32812150784 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec255d4fd4c8927df5efeedc7533f1fb SystemUUID:ec255d4f-d4c8-927d-f5ef-eedc7533f1fb BootID:6695f73a-1eeb-4897-9bc9-643d6263b761 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406073344 Type:vfs Inodes:4005389 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ca:18:e6:21 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ca:18:e6:21 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:f4:a3:75:61:9c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812150784 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 19 04:13:31.783815 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.783802    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 19 04:13:31.784010 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.783923    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.141.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260914-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 19 04:13:31.785135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.785098    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 19 04:13:31.785321 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.785140    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-253.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 19 04:13:31.785925 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.785913    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 19 04:13:31.785969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.785929    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 19 04:13:31.785969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.785937    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 04:13:31.786612 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.786601    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 19 04:13:31.786693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.786684    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 19 04:13:31.791064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791050    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 04:13:31.791183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791173    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 19 04:13:31.791227 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791213    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 19 04:13:31.791227 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791223    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 19 04:13:31.791296 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791234    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 19 04:13:31.791296 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791244    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 19 04:13:31.791296 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791254    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 19 04:13:31.791766 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791752    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 04:13:31.791805 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.791778    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 19 04:13:31.795467 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.795067    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.13-6.rhaos4.21.git6253162.el9" apiVersion="v1"
Sep 19 04:13:31.797797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.797778    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 19 04:13:31.797898 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.797820    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 19 04:13:31.799128 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799113    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799135    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799145    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799153    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799167    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799176    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 19 04:13:31.799199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799198    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 19 04:13:31.799452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799207    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 19 04:13:31.799452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799218    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 19 04:13:31.799452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799227    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 19 04:13:31.799452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799241    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 19 04:13:31.799452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799249    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 19 04:13:31.800004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.799992    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 19 04:13:31.800054 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.800007    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 19 04:13:31.804163 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.804145    2584 server.go:1268] "Started kubelet"
Sep 19 04:13:31.804279 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.804223    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 19 04:13:31.804335 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.804266    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 19 04:13:31.804402 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.804369    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 19 04:13:31.805181 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.805159    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 04:13:31.805252 ip-10-0-139-253 systemd[1]: Started Kubernetes Kubelet.
Sep 19 04:13:31.806504 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.806398    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 19 04:13:31.807675 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.807640    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 19 04:13:31.807675 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.807668    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-253.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 19 04:13:31.807830 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.807701    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 19 04:13:31.808168 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.808140    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 19 04:13:31.808761 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.808730    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 19 04:13:31.813732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.813713    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 19 04:13:31.813802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.813728    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 19 04:13:31.814220 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.813939    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:31.814595 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814581    2584 factory.go:55] Registering systemd factory
Sep 19 04:13:31.814692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814600    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 19 04:13:31.814692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814619    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 19 04:13:31.814692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814635    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 19 04:13:31.814692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814599    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 19 04:13:31.814931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814764    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 19 04:13:31.814931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814773    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 19 04:13:31.814931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814808    2584 factory.go:153] Registering CRI-O factory
Sep 19 04:13:31.814931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.814822    2584 factory.go:223] Registration of the crio container factory successfully
Sep 19 04:13:31.815130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.815077    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 19 04:13:31.815130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.815097    2584 factory.go:103] Registering Raw factory
Sep 19 04:13:31.815130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.815119    2584 manager.go:1196] Started watching for new ooms in manager
Sep 19 04:13:31.815694 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.815677    2584 manager.go:349] Starting recovery of all containers
Sep 19 04:13:31.818148 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.818098    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-253.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 19 04:13:31.818247 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.818208    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 19 04:13:31.818991 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.817417    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fd9b34199  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.804115353 +0000 UTC m=+0.338096783,LastTimestamp:2026-09-19 04:13:31.804115353 +0000 UTC m=+0.338096783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.828046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.827869    2584 manager.go:354] Recovery completed
Sep 19 04:13:31.829965 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.829921    2584 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 19 04:13:31.833342 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.833329    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:31.836383 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.836342    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:31.836480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.836396    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:31.836480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.836407    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:31.837099 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837086    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 19 04:13:31.837148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837100    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 19 04:13:31.837148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837117    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 19 04:13:31.837148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837133    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:31.837910 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837894    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:31.837969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837929    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:31.837969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.837941    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:31.839539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.839524    2584 policy_none.go:49] "None policy: Start"
Sep 19 04:13:31.839620 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.839542    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 19 04:13:31.839620 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.839553    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 19 04:13:31.840140 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.840075    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdb9f97e6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836381158 +0000 UTC m=+0.370362590,LastTimestamp:2026-09-19 04:13:31.836381158 +0000 UTC m=+0.370362590,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.841700 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.841689    2584 policy_none.go:47] "Start"
Sep 19 04:13:31.850435 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.850356    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdb9fe793  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836401555 +0000 UTC m=+0.370382988,LastTimestamp:2026-09-19 04:13:31.836401555 +0000 UTC m=+0.370382988,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.864552 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.864484    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdba00e7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836411516 +0000 UTC m=+0.370392948,LastTimestamp:2026-09-19 04:13:31.836411516 +0000 UTC m=+0.370392948,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.875999 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.875979    2584 manager.go:337] "Starting Device Plugin manager"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.876048    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876064    2584 server.go:87] "Starting device plugin registration server"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.876022    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-253.ec2.internal.18d69d9fdb9f97e6\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdb9f97e6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836381158 +0000 UTC m=+0.370362590,LastTimestamp:2026-09-19 04:13:31.837911058 +0000 UTC m=+0.371892489,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876291    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876305    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876417    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876502    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.876508    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.877073    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.877115    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.888546    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-253.ec2.internal.18d69d9fdb9fe793\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdb9fe793  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836401555 +0000 UTC m=+0.370382988,LastTimestamp:2026-09-19 04:13:31.837935107 +0000 UTC m=+0.371916538,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.902111 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.899402    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-139-253.ec2.internal.18d69d9fdba00e7c\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fdba00e7c  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-139-253.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.836411516 +0000 UTC m=+0.370392948,LastTimestamp:2026-09-19 04:13:31.837944582 +0000 UTC m=+0.371926015,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.906644 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.906626    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pz5cv"
Sep 19 04:13:31.913180 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.913123    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-253.ec2.internal.18d69d9fde26ca27  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-253.ec2.internal,UID:ip-10-0-139-253.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-139-253.ec2.internal,},FirstTimestamp:2026-09-19 04:13:31.878795815 +0000 UTC m=+0.412777233,LastTimestamp:2026-09-19 04:13:31.878795815 +0000 UTC m=+0.412777233,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-253.ec2.internal,}"
Sep 19 04:13:31.918746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.918727    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-pz5cv"
Sep 19 04:13:31.959163 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.959125    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 19 04:13:31.960634 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.960615    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 19 04:13:31.960713 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.960666    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 19 04:13:31.960713 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.960690    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 19 04:13:31.960798 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.960732    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 19 04:13:31.974079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.974063    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:31.977371 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.977314    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:31.978241 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.978224    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:31.978317 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.978256    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:31.978317 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.978266    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:31.978317 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.978291    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-253.ec2.internal"
Sep 19 04:13:31.986872 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:31.986855    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-253.ec2.internal"
Sep 19 04:13:31.986939 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:31.986880    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-253.ec2.internal\": node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.049169 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.049141    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.060867 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.060840    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"]
Sep 19 04:13:32.060951 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.060922    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:32.061833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.061815    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:32.061893 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.061847    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:32.061893 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.061857    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:32.064340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.064321    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:32.064456 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.064442    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.064496 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.064472    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:32.065224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065203    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:32.065335 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065234    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:32.065335 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065246    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:32.065415 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065203    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:32.065415 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065361    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:32.065415 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.065376    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:32.067724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.067708    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.067812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.067731    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:32.068508 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.068493    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:32.068583 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.068518    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:32.068583 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.068531    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:32.082937 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.082917    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-253.ec2.internal\" not found" node="ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.086523 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.086506    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-253.ec2.internal\" not found" node="ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.116531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.116508    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.116627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.116538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.116627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.116557    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bae3474ce280cf20dc08552c2fd617f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-253.ec2.internal\" (UID: \"bae3474ce280cf20dc08552c2fd617f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.151014 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.150974    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.217272 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.217272 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217267    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.217516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bae3474ce280cf20dc08552c2fd617f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-253.ec2.internal\" (UID: \"bae3474ce280cf20dc08552c2fd617f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.217516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/bae3474ce280cf20dc08552c2fd617f9-config\") pod \"kube-apiserver-proxy-ip-10-0-139-253.ec2.internal\" (UID: \"bae3474ce280cf20dc08552c2fd617f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.217516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217342    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.217516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.217350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a45c23a41eb2f618bb8041741cdbf43-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal\" (UID: \"7a45c23a41eb2f618bb8041741cdbf43\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.253072 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.253000    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.354506 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.354477    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.388088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.388053    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.390626 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.390611    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:32.454638 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.454608    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.555834 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.555812    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.626387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.626345    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:32.656789 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.656763    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.755517 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.755475    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 19 04:13:32.756153 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.755641    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 04:13:32.756153 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.755664    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 19 04:13:32.757774 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.757755    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.858432 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.858396    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:32.924826 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.924779    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-18 04:08:32 +0000 UTC" deadline="2028-03-17 21:20:52.670592261 +0000 UTC"
Sep 19 04:13:32.924826 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:32.924813    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13097h7m19.745782521s"
Sep 19 04:13:32.959107 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:32.959081    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-253.ec2.internal\" not found"
Sep 19 04:13:33.008228 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:33.008194    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbae3474ce280cf20dc08552c2fd617f9.slice/crio-2b4ec4588e5d7bcaa9b927c65691f5a1f27c06237b470004f0c09662009712c1 WatchSource:0}: Error finding container 2b4ec4588e5d7bcaa9b927c65691f5a1f27c06237b470004f0c09662009712c1: Status 404 returned error can't find the container with id 2b4ec4588e5d7bcaa9b927c65691f5a1f27c06237b470004f0c09662009712c1
Sep 19 04:13:33.008817 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:33.008786    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a45c23a41eb2f618bb8041741cdbf43.slice/crio-f511ef24d0d151af47c2febdcf50299358912793226be86e44a3bd72471575a5 WatchSource:0}: Error finding container f511ef24d0d151af47c2febdcf50299358912793226be86e44a3bd72471575a5: Status 404 returned error can't find the container with id f511ef24d0d151af47c2febdcf50299358912793226be86e44a3bd72471575a5
Sep 19 04:13:33.013911 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.013892    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:13:33.034108 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.034088    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 19 04:13:33.035581 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.035559    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientMemory"
Sep 19 04:13:33.035657 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.035604    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasNoDiskPressure"
Sep 19 04:13:33.035657 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.035618    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeHasSufficientPID"
Sep 19 04:13:33.043199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.043176    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:33.101225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.101176    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:33.114094 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.114074    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:33.165587 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.165572    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 04:13:33.166426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.166413    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal"
Sep 19 04:13:33.180327 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.180310    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 19 04:13:33.792698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.792670    2584 apiserver.go:52] "Watching apiserver"
Sep 19 04:13:33.802320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.802289    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 19 04:13:33.803773 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.803745    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qq5wm","openshift-dns/node-resolver-nftcf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal","openshift-multus/multus-2x9s2","openshift-multus/network-metrics-daemon-5tz5c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf","openshift-image-registry/node-ca-vmnnf","openshift-multus/multus-additional-cni-plugins-zl4rd","openshift-network-diagnostics/network-check-target-68wfb","openshift-network-operator/iptables-alerter-hxpfw","openshift-ovn-kubernetes/ovnkube-node-hnkqc","kube-system/global-pull-secret-syncer-pp4mx","kube-system/konnectivity-agent-qkpht"]
Sep 19 04:13:33.806501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.806476    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:33.806607 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.806568    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:33.808917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.808896    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.809022 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.808964    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:33.811071 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.811053    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.813875 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.813448    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.814059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.814030    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.814293 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.814274    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 19 04:13:33.815851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.815830    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.816602 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.816580    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.816858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.816835    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 19 04:13:33.816929 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.816862    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-rf9c9\""
Sep 19 04:13:33.817107 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.817060    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5hxrf\""
Sep 19 04:13:33.818260 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.818238    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:33.818348 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.818331    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:33.819062 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.819043    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hsjsd\""
Sep 19 04:13:33.819142 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.819073    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 19 04:13:33.819491 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.819473    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 19 04:13:33.820159 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.820140    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.820627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.820611    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.821242 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.821223    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.824075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.823801    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.826252 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ea72195-43ff-4484-886c-739fa5878e2e-hosts-file\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.826432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d8ebb6d-2838-49af-9268-e7a000674506-konnectivity-ca\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.826432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cnibin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826339    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cni-binary-copy\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-kubelet\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826395    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-conf-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826366    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea72195-43ff-4484-886c-739fa5878e2e-tmp-dir\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-socket-dir-parent\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-netns\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-bin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.826670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826660    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-daemon-config\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826691    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj6ql\" (UniqueName: \"kubernetes.io/projected/3ea72195-43ff-4484-886c-739fa5878e2e-kube-api-access-sj6ql\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d8ebb6d-2838-49af-9268-e7a000674506-agent-certs\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826740    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-multus-certs\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-dbus\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826806    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-system-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826862    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826893    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-k8s-cni-cncf-io\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826943    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-multus\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.826975    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-hostroot\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.827000    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-etc-kubernetes\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.827025    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7s4c\" (UniqueName: \"kubernetes.io/projected/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-kube-api-access-t7s4c\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.827068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.827053    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-kubelet-config\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.829175 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.829158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:33.833541 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.833517    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:33.833975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.833950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 19 04:13:33.834088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834026    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.834088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834046    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.834211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834021    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 19 04:13:33.834308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834285    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.834400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834324    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9xfg7\""
Sep 19 04:13:33.834484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834329    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xhwtw\""
Sep 19 04:13:33.834484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834434    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 19 04:13:33.834618 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834532    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-tvn8m\""
Sep 19 04:13:33.834696 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834621    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 19 04:13:33.834696 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834659    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.834810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834701    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.834810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834659    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 19 04:13:33.834810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834760    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.835001 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.834891    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-c5xfx\""
Sep 19 04:13:33.836197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.836179    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.842396 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.842258    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 19 04:13:33.842651 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.842632    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.846771    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xh47w\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.846860    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847010    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847142    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847222    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847404    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 19 04:13:33.847578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847572    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 19 04:13:33.849466 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847757    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 19 04:13:33.849466 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.847787    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-7xx4p\""
Sep 19 04:13:33.853877 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.853854    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 19 04:13:33.905464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.905424    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5phps"
Sep 19 04:13:33.916536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.916500    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 19 04:13:33.918232 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.918205    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5phps"
Sep 19 04:13:33.927291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-tmp\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.927399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927306    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-iptables-alerter-script\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:33.927399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc83c9f3-f699-4e99-8efb-b686472aee5e-host\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:33.927399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-netns\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.927557 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.927557 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-socket-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.927557 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927502    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfggn\" (UniqueName: \"kubernetes.io/projected/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-kube-api-access-pfggn\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:33.927557 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927536    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927584    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4np2m\" (UniqueName: \"kubernetes.io/projected/6e2983ea-2894-4e28-9881-30ad1b70f479-kube-api-access-4np2m\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927622    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ea72195-43ff-4484-886c-739fa5878e2e-hosts-file\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927669    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-conf\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2njd\" (UniqueName: \"kubernetes.io/projected/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kube-api-access-z2njd\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3ea72195-43ff-4484-886c-739fa5878e2e-hosts-file\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.927736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-netns\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-bin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927778    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927785    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-netns\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-kubelet\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-var-lib-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927833    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-bin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927878    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-cnibin\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927937    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-var-lib-kubelet\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.927995    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-systemd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-modprobe-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-system-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928153    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-k8s-cni-cncf-io\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928185    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-sys-fs\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928214    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928215    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-k8s-cni-cncf-io\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-node-log\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928296    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-system-cni-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928323    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-kubelet-config\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d8ebb6d-2838-49af-9268-e7a000674506-konnectivity-ca\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928371    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-kubelet-config\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928403    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-host\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928438    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bf7l\" (UniqueName: \"kubernetes.io/projected/d39a149d-0274-4f20-adfb-859aa8c8d9fb-kube-api-access-9bf7l\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-device-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928510    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928537    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-ovn\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.928655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928589    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-run\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-systemd-units\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928655    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-netd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928686    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-env-overrides\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928714    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj6ql\" (UniqueName: \"kubernetes.io/projected/3ea72195-43ff-4484-886c-739fa5878e2e-kube-api-access-sj6ql\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928739    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-multus-certs\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-system-cni-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928790    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scd6v\" (UniqueName: \"kubernetes.io/projected/6b21252f-30c8-419f-9303-d74919b5c777-kube-api-access-scd6v\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928816    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-tuned\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928841    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e2983ea-2894-4e28-9881-30ad1b70f479-ovn-node-metrics-cert\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928866    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928890    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-lib-modules\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928924    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928948    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc83c9f3-f699-4e99-8efb-b686472aee5e-serviceca\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-bin\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.929421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928999    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-registration-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.928973    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7d8ebb6d-2838-49af-9268-e7a000674506-konnectivity-ca\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929034    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cnibin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929094    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-run-multus-certs\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929114    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-kubelet\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cnibin\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929145    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-daemon-config\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929182    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-kubelet\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929218    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-sys\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929350    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-host-slash\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929397    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea72195-43ff-4484-886c-739fa5878e2e-tmp-dir\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929443    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysconfig\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-systemd\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d8ebb6d-2838-49af-9268-e7a000674506-agent-certs\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.929490    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:33.930192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcc85\" (UniqueName: \"kubernetes.io/projected/b5262ca8-5acb-4c3b-8b47-722259900eab-kube-api-access-wcc85\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.929578    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:34.429542738 +0000 UTC m=+2.963524158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-kubernetes\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-slash\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929680    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-etc-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929727    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-daemon-config\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-dbus\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-multus\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-hostroot\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-etc-kubernetes\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929901    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7s4c\" (UniqueName: \"kubernetes.io/projected/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-kube-api-access-t7s4c\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929901    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-host-var-lib-cni-multus\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929851    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3ea72195-43ff-4484-886c-739fa5878e2e-tmp-dir\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929926    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fccp5\" (UniqueName: \"kubernetes.io/projected/bc83c9f3-f699-4e99-8efb-b686472aee5e-kube-api-access-fccp5\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f88126a7-6010-4997-a008-a1fabdb0e621-dbus\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929956    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-log-socket\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929981    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-config\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.930837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929988    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-hostroot\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.929988    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-etc-kubernetes\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cni-binary-copy\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-conf-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-script-lib\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-socket-dir-parent\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-binary-copy\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-conf-dir\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-multus-socket-dir-parent\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.931464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.930489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-cni-binary-copy\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.934043 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.934018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7d8ebb6d-2838-49af-9268-e7a000674506-agent-certs\") pod \"konnectivity-agent-qkpht\" (UID: \"7d8ebb6d-2838-49af-9268-e7a000674506\") " pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:33.946671 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.946646    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:33.946671 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.946672    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:33.946840 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.946686    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:33.946840 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:33.946753    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:13:34.446732291 +0000 UTC m=+2.980713714 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:33.948609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.948588    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7s4c\" (UniqueName: \"kubernetes.io/projected/658d2760-c41a-4a7a-bcd6-93c9563cfdd5-kube-api-access-t7s4c\") pod \"multus-2x9s2\" (UID: \"658d2760-c41a-4a7a-bcd6-93c9563cfdd5\") " pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:33.954389 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.954321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj6ql\" (UniqueName: \"kubernetes.io/projected/3ea72195-43ff-4484-886c-739fa5878e2e-kube-api-access-sj6ql\") pod \"node-resolver-nftcf\" (UID: \"3ea72195-43ff-4484-886c-739fa5878e2e\") " pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:33.968210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.968126    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal" event={"ID":"7a45c23a41eb2f618bb8041741cdbf43","Type":"ContainerStarted","Data":"f511ef24d0d151af47c2febdcf50299358912793226be86e44a3bd72471575a5"}
Sep 19 04:13:33.969756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:33.969731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal" event={"ID":"bae3474ce280cf20dc08552c2fd617f9","Type":"ContainerStarted","Data":"2b4ec4588e5d7bcaa9b927c65691f5a1f27c06237b470004f0c09662009712c1"}
Sep 19 04:13:34.030518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030481    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-sys\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030535    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-host-slash\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysconfig\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030601    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-systemd\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030627    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcc85\" (UniqueName: \"kubernetes.io/projected/b5262ca8-5acb-4c3b-8b47-722259900eab-kube-api-access-wcc85\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-sys\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030651    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-kubernetes\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.030682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-slash\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-systemd\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030700    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-etc-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysconfig\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030741    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-kubernetes\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030745    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fccp5\" (UniqueName: \"kubernetes.io/projected/bc83c9f3-f699-4e99-8efb-b686472aee5e-kube-api-access-fccp5\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-host-slash\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-log-socket\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-etc-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030796    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-config\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030822    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-slash\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030825    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-script-lib\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030852    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-binary-copy\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030875    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-tmp\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030900    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-iptables-alerter-script\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc83c9f3-f699-4e99-8efb-b686472aee5e-host\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.030982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-netns\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031010    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031040    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-socket-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031066    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfggn\" (UniqueName: \"kubernetes.io/projected/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-kube-api-access-pfggn\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031093    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4np2m\" (UniqueName: \"kubernetes.io/projected/6e2983ea-2894-4e28-9881-30ad1b70f479-kube-api-access-4np2m\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-conf\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031226    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2njd\" (UniqueName: \"kubernetes.io/projected/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kube-api-access-z2njd\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031255    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031280    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-kubelet\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-var-lib-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031305    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-log-socket\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031370    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-cnibin\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031433    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-var-lib-kubelet\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031445    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-script-lib\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031461    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.031956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031572    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-etc-selinux\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031774    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031804    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-socket-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031913    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-ovnkube-config\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032020    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-var-lib-kubelet\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032070    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-ovn-kubernetes\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.031435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc83c9f3-f699-4e99-8efb-b686472aee5e-host\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-cnibin\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-var-lib-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-systemd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.032179    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-modprobe-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-conf\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.032233    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:13:34.5322159 +0000 UTC m=+3.066197348 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032244    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032263    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-sys-fs\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.032792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032307    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-node-log\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-modprobe-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-host\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032391    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-systemd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bf7l\" (UniqueName: \"kubernetes.io/projected/d39a149d-0274-4f20-adfb-859aa8c8d9fb-kube-api-access-9bf7l\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032450    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-kubelet\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-host\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032473    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-iptables-alerter-script\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-node-log\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032497    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-device-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032506    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-sys-fs\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032522    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-run-netns\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032526    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032558    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-ovn\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-openvswitch\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-device-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-run\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032621    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-systemd-units\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.033538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-run-ovn\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-netd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032681    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-netd\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-systemd-units\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-env-overrides\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-system-cni-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scd6v\" (UniqueName: \"kubernetes.io/projected/6b21252f-30c8-419f-9303-d74919b5c777-kube-api-access-scd6v\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032692    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-run\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032773    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-system-cni-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-tuned\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032819    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e2983ea-2894-4e28-9881-30ad1b70f479-ovn-node-metrics-cert\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-lib-modules\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032915    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc83c9f3-f699-4e99-8efb-b686472aee5e-serviceca\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-bin\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032967    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-registration-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.034292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.032996    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033063    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b21252f-30c8-419f-9303-d74919b5c777-cni-binary-copy\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033083    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6e2983ea-2894-4e28-9881-30ad1b70f479-env-overrides\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033144    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-sysctl-d\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d39a149d-0274-4f20-adfb-859aa8c8d9fb-lib-modules\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033207    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6e2983ea-2894-4e28-9881-30ad1b70f479-host-cni-bin\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033226    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b21252f-30c8-419f-9303-d74919b5c777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/36934476-24fb-4f07-9fe0-fa68ae2c9b69-registration-dir\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.033532    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/bc83c9f3-f699-4e99-8efb-b686472aee5e-serviceca\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.034974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.034004    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-tmp\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.035508 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.035461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6e2983ea-2894-4e28-9881-30ad1b70f479-ovn-node-metrics-cert\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.037434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.037412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/d39a149d-0274-4f20-adfb-859aa8c8d9fb-etc-tuned\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.053716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.053658    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fccp5\" (UniqueName: \"kubernetes.io/projected/bc83c9f3-f699-4e99-8efb-b686472aee5e-kube-api-access-fccp5\") pod \"node-ca-vmnnf\" (UID: \"bc83c9f3-f699-4e99-8efb-b686472aee5e\") " pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.055709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.055687    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcc85\" (UniqueName: \"kubernetes.io/projected/b5262ca8-5acb-4c3b-8b47-722259900eab-kube-api-access-wcc85\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:34.070654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.070628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2njd\" (UniqueName: \"kubernetes.io/projected/36934476-24fb-4f07-9fe0-fa68ae2c9b69-kube-api-access-z2njd\") pod \"aws-ebs-csi-driver-node-8rbpf\" (UID: \"36934476-24fb-4f07-9fe0-fa68ae2c9b69\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.090662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.090640    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfggn\" (UniqueName: \"kubernetes.io/projected/588fc1e2-ac5e-4cbc-964e-3e97b0f12c39-kube-api-access-pfggn\") pod \"iptables-alerter-hxpfw\" (UID: \"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39\") " pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.092674 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.092653    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scd6v\" (UniqueName: \"kubernetes.io/projected/6b21252f-30c8-419f-9303-d74919b5c777-kube-api-access-scd6v\") pod \"multus-additional-cni-plugins-zl4rd\" (UID: \"6b21252f-30c8-419f-9303-d74919b5c777\") " pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.097187 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.097169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bf7l\" (UniqueName: \"kubernetes.io/projected/d39a149d-0274-4f20-adfb-859aa8c8d9fb-kube-api-access-9bf7l\") pod \"tuned-qq5wm\" (UID: \"d39a149d-0274-4f20-adfb-859aa8c8d9fb\") " pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.097838 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.097818    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:34.100044 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.100020    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4np2m\" (UniqueName: \"kubernetes.io/projected/6e2983ea-2894-4e28-9881-30ad1b70f479-kube-api-access-4np2m\") pod \"ovnkube-node-hnkqc\" (UID: \"6e2983ea-2894-4e28-9881-30ad1b70f479\") " pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.125552 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.125530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nftcf"
Sep 19 04:13:34.133990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.133968    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:34.144400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.144382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-2x9s2"
Sep 19 04:13:34.151709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.151690    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zl4rd"
Sep 19 04:13:34.160642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.160623    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf"
Sep 19 04:13:34.167516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.167499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qq5wm"
Sep 19 04:13:34.175779 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.175736    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vmnnf"
Sep 19 04:13:34.185084 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.185068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-hxpfw"
Sep 19 04:13:34.192879 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.192858    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:34.436021 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.435932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:34.436183 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.436084    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:34.436183 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.436154    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:35.436140538 +0000 UTC m=+3.970121956 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:34.536332 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.536279    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:34.536534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.536388    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:34.536534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536490    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:34.536534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536494    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:34.536534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536525    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:34.536534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536538    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:34.536757 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536549    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:13:35.536531103 +0000 UTC m=+4.070512521 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:34.536757 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.536592    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:13:35.536574424 +0000 UTC m=+4.070555847 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:34.921993 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.921955    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 04:08:34 +0000 UTC" deadline="2028-03-08 16:51:40.880591672 +0000 UTC"
Sep 19 04:13:34.921993 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.921989    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12876h38m5.958606846s"
Sep 19 04:13:34.962666 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:34.962630    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:34.962858 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:34.962775    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:35.093490 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.093405    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ea72195_43ff_4484_886c_739fa5878e2e.slice/crio-f8ded30df5f40798ef3b05e464af391580e5fd9afe54061d1e394e73b74ada09 WatchSource:0}: Error finding container f8ded30df5f40798ef3b05e464af391580e5fd9afe54061d1e394e73b74ada09: Status 404 returned error can't find the container with id f8ded30df5f40798ef3b05e464af391580e5fd9afe54061d1e394e73b74ada09
Sep 19 04:13:35.095769 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.095185    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b21252f_30c8_419f_9303_d74919b5c777.slice/crio-377adff97f3338e00cca5a48b7b13f5d7fea5e719c9cb9b4c9eeae30371b5698 WatchSource:0}: Error finding container 377adff97f3338e00cca5a48b7b13f5d7fea5e719c9cb9b4c9eeae30371b5698: Status 404 returned error can't find the container with id 377adff97f3338e00cca5a48b7b13f5d7fea5e719c9cb9b4c9eeae30371b5698
Sep 19 04:13:35.097613 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.097451    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd39a149d_0274_4f20_adfb_859aa8c8d9fb.slice/crio-629f3caf59aa6be1ec34d4bd9ff15985854369dbb61bd7c27e9f6efb40804598 WatchSource:0}: Error finding container 629f3caf59aa6be1ec34d4bd9ff15985854369dbb61bd7c27e9f6efb40804598: Status 404 returned error can't find the container with id 629f3caf59aa6be1ec34d4bd9ff15985854369dbb61bd7c27e9f6efb40804598
Sep 19 04:13:35.097924 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.097894    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc83c9f3_f699_4e99_8efb_b686472aee5e.slice/crio-f010341950191df1a9fc177e6ff7c731b74006f1cf88c752bdef3f67fdc83d07 WatchSource:0}: Error finding container f010341950191df1a9fc177e6ff7c731b74006f1cf88c752bdef3f67fdc83d07: Status 404 returned error can't find the container with id f010341950191df1a9fc177e6ff7c731b74006f1cf88c752bdef3f67fdc83d07
Sep 19 04:13:35.102929 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.102818    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36934476_24fb_4f07_9fe0_fa68ae2c9b69.slice/crio-72c44d2b0878f3f7b157387a47daa7583d183c1893a92a5a635687c4c976ad8d WatchSource:0}: Error finding container 72c44d2b0878f3f7b157387a47daa7583d183c1893a92a5a635687c4c976ad8d: Status 404 returned error can't find the container with id 72c44d2b0878f3f7b157387a47daa7583d183c1893a92a5a635687c4c976ad8d
Sep 19 04:13:35.126189 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.126161    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod658d2760_c41a_4a7a_bcd6_93c9563cfdd5.slice/crio-461ee4ebbba3eb3d1813c9ec5d939cc7a5a685d21d5e0928f9174551b4755140 WatchSource:0}: Error finding container 461ee4ebbba3eb3d1813c9ec5d939cc7a5a685d21d5e0928f9174551b4755140: Status 404 returned error can't find the container with id 461ee4ebbba3eb3d1813c9ec5d939cc7a5a685d21d5e0928f9174551b4755140
Sep 19 04:13:35.127136 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.127101    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod588fc1e2_ac5e_4cbc_964e_3e97b0f12c39.slice/crio-394133467c94b917799bc1414074f991a235654affbe6b8f6d9420b63ef17a8e WatchSource:0}: Error finding container 394133467c94b917799bc1414074f991a235654affbe6b8f6d9420b63ef17a8e: Status 404 returned error can't find the container with id 394133467c94b917799bc1414074f991a235654affbe6b8f6d9420b63ef17a8e
Sep 19 04:13:35.128470 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.128451    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d8ebb6d_2838_49af_9268_e7a000674506.slice/crio-a9f3052839d92394a0b3e797452ff58a50ac371c5641e52d8ed31e20f4eedaef WatchSource:0}: Error finding container a9f3052839d92394a0b3e797452ff58a50ac371c5641e52d8ed31e20f4eedaef: Status 404 returned error can't find the container with id a9f3052839d92394a0b3e797452ff58a50ac371c5641e52d8ed31e20f4eedaef
Sep 19 04:13:35.129748 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:13:35.129724    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e2983ea_2894_4e28_9881_30ad1b70f479.slice/crio-124a1addfac0e6c84753c0b6889b1628cb527db1f768f7c8c2666c929626d577 WatchSource:0}: Error finding container 124a1addfac0e6c84753c0b6889b1628cb527db1f768f7c8c2666c929626d577: Status 404 returned error can't find the container with id 124a1addfac0e6c84753c0b6889b1628cb527db1f768f7c8c2666c929626d577
Sep 19 04:13:35.440491 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.440410    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 19 04:13:35.444595 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.444575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:35.444811 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.444778    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:35.444888 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.444836    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:37.444822217 +0000 UTC m=+5.978803635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.545164    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.545228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545337    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545398    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545420    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545437    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545403    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:13:37.545386054 +0000 UTC m=+6.079367472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:35.545526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.545499    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:13:37.545482332 +0000 UTC m=+6.079463755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:35.922387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.922311    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-18 04:08:34 +0000 UTC" deadline="2028-07-06 19:28:53.157611232 +0000 UTC"
Sep 19 04:13:35.922387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.922373    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15759h15m17.235242922s"
Sep 19 04:13:35.963747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.963714    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:35.963939 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.963858    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:35.964320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.964279    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:35.964445 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:35.964421    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:35.991916 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:35.991788    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"124a1addfac0e6c84753c0b6889b1628cb527db1f768f7c8c2666c929626d577"}
Sep 19 04:13:36.007022 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.006987    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxpfw" event={"ID":"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39","Type":"ContainerStarted","Data":"394133467c94b917799bc1414074f991a235654affbe6b8f6d9420b63ef17a8e"}
Sep 19 04:13:36.018950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.018917    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf" event={"ID":"36934476-24fb-4f07-9fe0-fa68ae2c9b69","Type":"ContainerStarted","Data":"72c44d2b0878f3f7b157387a47daa7583d183c1893a92a5a635687c4c976ad8d"}
Sep 19 04:13:36.039119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.039076    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmnnf" event={"ID":"bc83c9f3-f699-4e99-8efb-b686472aee5e","Type":"ContainerStarted","Data":"f010341950191df1a9fc177e6ff7c731b74006f1cf88c752bdef3f67fdc83d07"}
Sep 19 04:13:36.053462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.053190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerStarted","Data":"377adff97f3338e00cca5a48b7b13f5d7fea5e719c9cb9b4c9eeae30371b5698"}
Sep 19 04:13:36.057306 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.057250    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nftcf" event={"ID":"3ea72195-43ff-4484-886c-739fa5878e2e","Type":"ContainerStarted","Data":"f8ded30df5f40798ef3b05e464af391580e5fd9afe54061d1e394e73b74ada09"}
Sep 19 04:13:36.074573 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.074530    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a45c23a41eb2f618bb8041741cdbf43" containerID="f46d260439c31cb117376a98f7467c013750d44ea9ce4abf435409326b0709e0" exitCode=0
Sep 19 04:13:36.074743 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.074624    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal" event={"ID":"7a45c23a41eb2f618bb8041741cdbf43","Type":"ContainerDied","Data":"f46d260439c31cb117376a98f7467c013750d44ea9ce4abf435409326b0709e0"}
Sep 19 04:13:36.105253 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.105203    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal" event={"ID":"bae3474ce280cf20dc08552c2fd617f9","Type":"ContainerStarted","Data":"5ad76406ec5508d2374c2ca2900aec5f7e7eb78f2c4330e6beca95e276d7c25a"}
Sep 19 04:13:36.123728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.123687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x9s2" event={"ID":"658d2760-c41a-4a7a-bcd6-93c9563cfdd5","Type":"ContainerStarted","Data":"461ee4ebbba3eb3d1813c9ec5d939cc7a5a685d21d5e0928f9174551b4755140"}
Sep 19 04:13:36.151103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.151068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qkpht" event={"ID":"7d8ebb6d-2838-49af-9268-e7a000674506","Type":"ContainerStarted","Data":"a9f3052839d92394a0b3e797452ff58a50ac371c5641e52d8ed31e20f4eedaef"}
Sep 19 04:13:36.169341 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.169306    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qq5wm" event={"ID":"d39a149d-0274-4f20-adfb-859aa8c8d9fb","Type":"ContainerStarted","Data":"629f3caf59aa6be1ec34d4bd9ff15985854369dbb61bd7c27e9f6efb40804598"}
Sep 19 04:13:36.961577 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:36.961540    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:36.962079 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:36.961683    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:37.189371 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.189336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal" event={"ID":"7a45c23a41eb2f618bb8041741cdbf43","Type":"ContainerStarted","Data":"b485624a663c1c61536cc72019d9305baa39d53df04b2c65f1b7a57246964c0a"}
Sep 19 04:13:37.208536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.208478    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-253.ec2.internal" podStartSLOduration=4.208457297 podStartE2EDuration="4.208457297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:36.126004454 +0000 UTC m=+4.659985898" watchObservedRunningTime="2026-09-19 04:13:37.208457297 +0000 UTC m=+5.742438736"
Sep 19 04:13:37.463167 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.463131    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:37.463358 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.463270    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:37.463358 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.463346    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:41.463328288 +0000 UTC m=+9.997309704 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:37.563491 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.563453    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:37.563717 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.563520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:37.563717 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.563695    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:37.563717 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.563712    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:37.563878 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.563724    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:37.563878 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.563781    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:13:41.563760647 +0000 UTC m=+10.097742063 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:37.564184 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.564165    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:37.564252 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.564217    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:13:41.564203149 +0000 UTC m=+10.098184566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:37.964143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.963384    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:37.964143 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.963510    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:37.964143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:37.963992    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:37.964143 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:37.964095    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:38.961887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:38.961850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:38.962057 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:38.961976    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:39.962830 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:39.962376    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:39.962830 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:39.962496    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:39.962830 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:39.962514    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:39.962830 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:39.962607    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:40.961135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:40.961055    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:40.961326 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:40.961176    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:41.496688 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:41.496623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:41.497133 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.496756    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:41.497133 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.496834    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:13:49.496814497 +0000 UTC m=+18.030795930 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:41.597746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:41.597704    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:41.597912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:41.597780    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:41.597980 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.597947    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:41.597980 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.597963    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:41.597980 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.597972    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:41.598126 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.598017    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:13:49.598005179 +0000 UTC m=+18.131986595 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:41.598461 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.598444    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:41.598551 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.598488    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:13:49.598477513 +0000 UTC m=+18.132458928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:41.962575 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:41.962536    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:41.962786 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.962649    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:41.963162 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:41.963139    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:41.963366 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:41.963337    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:42.961577 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:42.961089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:42.961577 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:42.961219    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:43.962135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:43.961674    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:43.962135 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:43.961806    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:43.962135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:43.961864    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:43.962135 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:43.961956    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:44.961318 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:44.961258    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:44.961481 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:44.961384    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:45.964615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:45.964586    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:45.965009 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:45.964692    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:45.965009 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:45.964783    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:45.965009 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:45.964891    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:46.960962 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:46.960925    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:46.961159 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:46.961055    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:47.961296 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:47.961246    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:47.961730 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:47.961374    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:47.961730 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:47.961430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:47.961730 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:47.961524    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:48.961565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:48.961068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:48.961565 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:48.961200    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:49.553308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:49.553257    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:49.553484 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.553401    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:49.553484 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.553472    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:05.553455488 +0000 UTC m=+34.087436904 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:13:49.654202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:49.654146    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:49.654386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:49.654214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:49.654386 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654357    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:13:49.654386 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654378    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:13:49.654534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654393    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:49.654534 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654441    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:05.654429761 +0000 UTC m=+34.188411177 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:13:49.654802 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654770    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:49.654919 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.654842    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:14:05.65482497 +0000 UTC m=+34.188806405 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:13:49.964121 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:49.964058    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:49.964551 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:49.964062    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:49.964551 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.964152    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:49.964551 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:49.964227    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:50.961508 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:50.961477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:50.961668 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:50.961579    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:51.962142 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:51.962102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:51.962573 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:51.962206    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:51.962644 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:51.962609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:51.962722 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:51.962704    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:52.961184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:52.961152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:52.961360 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:52.961305    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:53.965630 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:53.965348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:53.966381 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:53.965367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:53.966381 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:53.965723    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:53.966381 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:53.965777    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:54.225607 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.225558    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qq5wm" event={"ID":"d39a149d-0274-4f20-adfb-859aa8c8d9fb","Type":"ContainerStarted","Data":"1a1484798323b5deedc1a6b1b90acb369a35ea06bfef6d74625c14591e964488"}
Sep 19 04:13:54.228813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.228785    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"bcac3500dcf73cd955afcc232102613eb75b7616a28c377466f72e53a5b4e243"}
Sep 19 04:13:54.228940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.228860    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"cc1d5e0e2a5b322538a259f99e855fd4565854e30b334ccb4ffae712901bf544"}
Sep 19 04:13:54.228940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.228889    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"9d1c278f20ccad590030d120b2250796b547f2a461ee53309f4992c61f855aad"}
Sep 19 04:13:54.228940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.228924    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"c53ab4bebce9c436033db19af0bcd9e203c1c949dc32e823bebee9b1d34053b6"}
Sep 19 04:13:54.229089 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.228972    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"5117bbd1dfe32cbe397e31133cbdcd88a0ffa97cb92bdaf86736b278ba54396a"}
Sep 19 04:13:54.229089 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.229017    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"39d3306beaeb430060513899d590233e835c122478d3bc6f59bb963a3cbcd2f8"}
Sep 19 04:13:54.230432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.230412    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf" event={"ID":"36934476-24fb-4f07-9fe0-fa68ae2c9b69","Type":"ContainerStarted","Data":"22fd1c9c4cfb7d5b6ab94550efeb31b669fafe8e8874498aed452960db4ab488"}
Sep 19 04:13:54.231828 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.231807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vmnnf" event={"ID":"bc83c9f3-f699-4e99-8efb-b686472aee5e","Type":"ContainerStarted","Data":"20c6084e6d41a250a56da78a3347938c0a1ebfac5a38b84acc8a889ec479c679"}
Sep 19 04:13:54.233557 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.233537    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="fc6867778ad661caf1e15e75413641fe832a6634778e0f3bb91d386993ddb4f7" exitCode=0
Sep 19 04:13:54.233631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.233606    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"fc6867778ad661caf1e15e75413641fe832a6634778e0f3bb91d386993ddb4f7"}
Sep 19 04:13:54.235311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.235291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nftcf" event={"ID":"3ea72195-43ff-4484-886c-739fa5878e2e","Type":"ContainerStarted","Data":"b601f6a0f61401b5d020cd9aa74087425085f736dfe57b4d5baa3bb74f619759"}
Sep 19 04:13:54.236940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.236923    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-2x9s2" event={"ID":"658d2760-c41a-4a7a-bcd6-93c9563cfdd5","Type":"ContainerStarted","Data":"3c88a79c097898534cf4f95685d939dbd76bc7978e298e3d22e9d3341321bbf2"}
Sep 19 04:13:54.238290 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.238261    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qkpht" event={"ID":"7d8ebb6d-2838-49af-9268-e7a000674506","Type":"ContainerStarted","Data":"978f307114bbe929ad913eb6499228ee676479752f33bd126b9fa69a66d3174a"}
Sep 19 04:13:54.252139 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.252102    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-253.ec2.internal" podStartSLOduration=21.252091589 podStartE2EDuration="21.252091589s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:37.208972579 +0000 UTC m=+5.742954018" watchObservedRunningTime="2026-09-19 04:13:54.252091589 +0000 UTC m=+22.786073026"
Sep 19 04:13:54.288020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.287979    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qq5wm" podStartSLOduration=3.853998848 podStartE2EDuration="22.287966344s" totalImagesPullingTime="18.433967496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:54.257231782 +0000 UTC m=+22.791213223" watchObservedRunningTime="2026-09-19 04:13:54.287966344 +0000 UTC m=+22.821947782"
Sep 19 04:13:54.325697 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.325617    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nftcf" podStartSLOduration=3.883364988 podStartE2EDuration="22.325604008s" totalImagesPullingTime="18.44223902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:54.2903594 +0000 UTC m=+22.824340841" watchObservedRunningTime="2026-09-19 04:13:54.325604008 +0000 UTC m=+22.859585445"
Sep 19 04:13:54.325817 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.325721    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-2x9s2" podStartSLOduration=3.87709501 podStartE2EDuration="22.325715567s" totalImagesPullingTime="18.448620557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:54.323853213 +0000 UTC m=+22.857834651" watchObservedRunningTime="2026-09-19 04:13:54.325715567 +0000 UTC m=+22.859697004"
Sep 19 04:13:54.492296 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.492236    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qkpht" podStartSLOduration=4.089942465 podStartE2EDuration="22.492219928s" totalImagesPullingTime="18.402277463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:54.491568481 +0000 UTC m=+23.025549922" watchObservedRunningTime="2026-09-19 04:13:54.492219928 +0000 UTC m=+23.026201366"
Sep 19 04:13:54.550967 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.550902    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vmnnf" podStartSLOduration=4.137873471 podStartE2EDuration="22.550881376s" totalImagesPullingTime="18.413007905s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:54.550639722 +0000 UTC m=+23.084621163" watchObservedRunningTime="2026-09-19 04:13:54.550881376 +0000 UTC m=+23.084862815"
Sep 19 04:13:54.961780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:54.961751    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:54.961923 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:54.961853    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:55.145544 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.145519    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 19 04:13:55.243125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.243088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-hxpfw" event={"ID":"588fc1e2-ac5e-4cbc-964e-3e97b0f12c39","Type":"ContainerStarted","Data":"8b55daca742b5e10adc0cb6264b047cecbaaf073aa04cb39169457351fafb09c"}
Sep 19 04:13:55.245702 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.245669    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf" event={"ID":"36934476-24fb-4f07-9fe0-fa68ae2c9b69","Type":"ContainerStarted","Data":"906c2c06d56e7558da02bdb5041ae632a4451864777a1758105cc045b93a1576"}
Sep 19 04:13:55.268478 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.268429    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-hxpfw" podStartSLOduration=4.854261624 podStartE2EDuration="23.268408574s" totalImagesPullingTime="18.41414695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:55.268237661 +0000 UTC m=+23.802219101" watchObservedRunningTime="2026-09-19 04:13:55.268408574 +0000 UTC m=+23.802390006"
Sep 19 04:13:55.890726 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.890628    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-19T04:13:55.145538236Z","UUID":"93af489a-df7e-42ea-822d-b1a5c0ef795a","Handler":null,"Name":"","Endpoint":""}
Sep 19 04:13:55.892350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.892234    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 19 04:13:55.892350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.892266    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 19 04:13:55.964812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.964786    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:55.964933 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:55.964889    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:55.964994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:55.964952    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:55.965088 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:55.965067    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:56.251574 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:56.251548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf" event={"ID":"36934476-24fb-4f07-9fe0-fa68ae2c9b69","Type":"ContainerStarted","Data":"3cd469f924d30ae3d0ccd23ba8cbf6a7402153365079e9ada5cf91d5d7d65d09"}
Sep 19 04:13:56.284018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:56.283976    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8rbpf" podStartSLOduration=3.753390385 podStartE2EDuration="24.283961091s" totalImagesPullingTime="20.530570706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:56.283935369 +0000 UTC m=+24.817916807" watchObservedRunningTime="2026-09-19 04:13:56.283961091 +0000 UTC m=+24.817942559"
Sep 19 04:13:56.962162 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:56.961917    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:56.962364 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:56.962292    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:57.262792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:57.262713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"4fa8a8b698b08ef06c10fad81c9db90718d1bad58b82598973a1735b1e58f410"}
Sep 19 04:13:57.961912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:57.961880    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:57.962123 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:57.962008    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:57.962123 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:57.962065    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:57.962197 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:57.962168    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:13:58.279730 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:58.279659    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:58.280202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:58.280177    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:58.961588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:58.961553    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:13:58.961733 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:58.961694    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:13:59.270645 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.270613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" event={"ID":"6e2983ea-2894-4e28-9881-30ad1b70f479","Type":"ContainerStarted","Data":"73342fc7a3b9ee184c48a9bf68ed616121a4a6792530d1247e8b8fc7464d3af2"}
Sep 19 04:13:59.270851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.270835    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:59.272662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.272635    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="ea7033e724feb5d40b30da4825053a7447c2d75fe8b9be02cf5c0cd07ce0e6a2" exitCode=0
Sep 19 04:13:59.272773 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.272714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"ea7033e724feb5d40b30da4825053a7447c2d75fe8b9be02cf5c0cd07ce0e6a2"}
Sep 19 04:13:59.272931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.272912    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:59.273548 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.273444    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qkpht"
Sep 19 04:13:59.287673 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.287658    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:13:59.347328 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.347267    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc" podStartSLOduration=8.840332707 podStartE2EDuration="27.347254392s" totalImagesPullingTime="18.506921685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:13:59.343054288 +0000 UTC m=+27.877035736" watchObservedRunningTime="2026-09-19 04:13:59.347254392 +0000 UTC m=+27.881235830"
Sep 19 04:13:59.962230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.961835    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:13:59.962230 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:59.961947    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:13:59.962230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:13:59.961998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:13:59.962230 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:13:59.962092    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:14:00.274912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:00.274841    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:14:00.275079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:00.274930    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:14:00.290364 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:00.290337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:14:00.961089 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:00.961020    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:00.961216 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:00.961121    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:14:01.202059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.202025    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5tz5c"]
Sep 19 04:14:01.202215 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.202130    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:01.202262 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:01.202225    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:14:01.208619 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.208591    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pp4mx"]
Sep 19 04:14:01.209099 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.209080    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68wfb"]
Sep 19 04:14:01.209207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.209152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:01.209253 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:01.209231    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:14:01.279132 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.279052    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="4f3bd5b6fb5caaedba4c8733c55fe17414dc6d41380b0fd08f52608bc222b51b" exitCode=0
Sep 19 04:14:01.279132 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.279114    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:01.279350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:01.279147    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"4f3bd5b6fb5caaedba4c8733c55fe17414dc6d41380b0fd08f52608bc222b51b"}
Sep 19 04:14:01.279498 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:01.279472    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:14:02.283846 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:02.283759    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="1badf82727157035a13fbbe0bc9d62f16648bec441d287e779729e7d105eeece" exitCode=0
Sep 19 04:14:02.284266 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:02.283849    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"1badf82727157035a13fbbe0bc9d62f16648bec441d287e779729e7d105eeece"}
Sep 19 04:14:02.961290 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:02.961236    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:02.961456 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:02.961373    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:14:02.961754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:02.961738    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:02.961842 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:02.961827    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:14:02.961894 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:02.961884    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:02.961968 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:02.961952    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:14:04.961108 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:04.960916    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:04.961603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:04.960955    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:04.961603 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:04.961195    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-68wfb" podUID="3a5d895d-fcbd-441e-8839-2943bba2143f"
Sep 19 04:14:04.961603 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:04.961308    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5tz5c" podUID="b5262ca8-5acb-4c3b-8b47-722259900eab"
Sep 19 04:14:04.961603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:04.960965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:04.961603 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:04.961402    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-pp4mx" podUID="f88126a7-6010-4997-a008-a1fabdb0e621"
Sep 19 04:14:05.573423 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:05.573384    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:05.573671 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.573507    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 19 04:14:05.573671 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.573571    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret podName:f88126a7-6010-4997-a008-a1fabdb0e621 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.57355343 +0000 UTC m=+66.107534867 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret") pod "global-pull-secret-syncer-pp4mx" (UID: "f88126a7-6010-4997-a008-a1fabdb0e621") : object "kube-system"/"original-pull-secret" not registered
Sep 19 04:14:05.673909 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:05.673868    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:05.674110 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:05.673934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:05.674110 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674004    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:14:05.674110 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674080    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.674060942 +0000 UTC m=+66.208042361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 19 04:14:05.674110 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674089    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 19 04:14:05.674110 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674110    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 19 04:14:05.674420 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674122    2584 projected.go:196] Error preparing data for projected volume kube-api-access-zq9s2 for pod openshift-network-diagnostics/network-check-target-68wfb: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:14:05.674420 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:05.674175    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2 podName:3a5d895d-fcbd-441e-8839-2943bba2143f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.674158781 +0000 UTC m=+66.208140199 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zq9s2" (UniqueName: "kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2") pod "network-check-target-68wfb" (UID: "3a5d895d-fcbd-441e-8839-2943bba2143f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 19 04:14:06.260739 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.260706    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-253.ec2.internal" event="NodeReady"
Sep 19 04:14:06.261308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.260827    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 19 04:14:06.343981 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.343905    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:14:06.382999 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.382970    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.387608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.387578    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnxhx\""
Sep 19 04:14:06.388173 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.388146    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 19 04:14:06.388305 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.388146    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 19 04:14:06.388305 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.388183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 19 04:14:06.392363 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.392343    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:14:06.399769 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.399663    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r4tvx"]
Sep 19 04:14:06.419140 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.419116    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.430700 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.430681    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 19 04:14:06.430802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.430718    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 19 04:14:06.430955 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.430939    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-q6xzq\""
Sep 19 04:14:06.431326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.431312    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lx2tb"]
Sep 19 04:14:06.447293 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.447260    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.467301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.467257    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 19 04:14:06.467499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.467482    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 19 04:14:06.467587 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.467550    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s7cn\""
Sep 19 04:14:06.467639 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.467486    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 19 04:14:06.467732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.467717    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 19 04:14:06.468621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.468580    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4tvx"]
Sep 19 04:14:06.478945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.478920    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ece9e24c-990e-4be0-ba4f-b5180d777b82-cert\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.479032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.478990    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479066    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479083    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-442qv\" (UniqueName: \"kubernetes.io/projected/ece9e24c-990e-4be0-ba4f-b5180d777b82-kube-api-access-442qv\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.479112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479252 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479128    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479252 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479147    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6vsm\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.479252 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.479212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.486341 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.486324    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lx2tb"]
Sep 19 04:14:06.580072 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580037    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580219    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580244    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/637b5af8-6cff-4d78-8940-52349943c82f-config-volume\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.580461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580316    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-442qv\" (UniqueName: \"kubernetes.io/projected/ece9e24c-990e-4be0-ba4f-b5180d777b82-kube-api-access-442qv\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.580461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580341    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.580610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580458    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhnz2\" (UniqueName: \"kubernetes.io/projected/637b5af8-6cff-4d78-8940-52349943c82f-kube-api-access-nhnz2\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.580610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580489    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/637b5af8-6cff-4d78-8940-52349943c82f-tmp-dir\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.580610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580520    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580594    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6vsm\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580759 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580618    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580759 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.580759 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.580694    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ece9e24c-990e-4be0-ba4f-b5180d777b82-cert\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.580759 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:06.580704    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:06.580759 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:06.580717    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:06.580971 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:06.580777    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:07.080757662 +0000 UTC m=+35.614739077 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:06.581375 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.581343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.581467 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.581407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.584941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.584920    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.584941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.584935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.585096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.585036    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ece9e24c-990e-4be0-ba4f-b5180d777b82-cert\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.595896 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.595850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-442qv\" (UniqueName: \"kubernetes.io/projected/ece9e24c-990e-4be0-ba4f-b5180d777b82-kube-api-access-442qv\") pod \"ingress-canary-r4tvx\" (UID: \"ece9e24c-990e-4be0-ba4f-b5180d777b82\") " pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.612156 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.612135    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.635945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.635916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6vsm\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:06.681996 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.681963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/637b5af8-6cff-4d78-8940-52349943c82f-config-volume\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.682185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.682007    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.682185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.682033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhnz2\" (UniqueName: \"kubernetes.io/projected/637b5af8-6cff-4d78-8940-52349943c82f-kube-api-access-nhnz2\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.682185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.682061    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/637b5af8-6cff-4d78-8940-52349943c82f-tmp-dir\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.682185 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:06.682145    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:06.682426 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:06.682221    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:07.182197988 +0000 UTC m=+35.716179421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:06.682493 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.682441    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/637b5af8-6cff-4d78-8940-52349943c82f-tmp-dir\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.682650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.682628    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/637b5af8-6cff-4d78-8940-52349943c82f-config-volume\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.728484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.728452    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r4tvx"
Sep 19 04:14:06.728738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.728723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhnz2\" (UniqueName: \"kubernetes.io/projected/637b5af8-6cff-4d78-8940-52349943c82f-kube-api-access-nhnz2\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:06.961123 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.961089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:06.961123 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.961125    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:06.961347 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.961090    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:06.968243 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.968159    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 04:14:06.968344 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.968320    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwkvg\""
Sep 19 04:14:06.968638 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.968615    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zg2ns\""
Sep 19 04:14:06.968990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.968974    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 04:14:06.969042 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.969028    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 04:14:06.969266 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:06.969252    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 04:14:07.085048 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:07.084877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:07.085209 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:07.084977    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:07.085209 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:07.085070    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:07.085209 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:07.085119    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:08.085105278 +0000 UTC m=+36.619086694 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:07.097333 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:07.097307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r4tvx"]
Sep 19 04:14:07.100718 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:07.100694    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podece9e24c_990e_4be0_ba4f_b5180d777b82.slice/crio-fc04df285ccde427bb99bd10ed84ce70c006791488ef3ad6f343ad15f4058f90 WatchSource:0}: Error finding container fc04df285ccde427bb99bd10ed84ce70c006791488ef3ad6f343ad15f4058f90: Status 404 returned error can't find the container with id fc04df285ccde427bb99bd10ed84ce70c006791488ef3ad6f343ad15f4058f90
Sep 19 04:14:07.185627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:07.185596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:07.185751 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:07.185724    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:07.185805 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:07.185787    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:08.185773042 +0000 UTC m=+36.719754457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:07.299497 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:07.299466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerStarted","Data":"6b63614631f5729beb58c33f26df713de74b8d6b2896fd9b2a68e835d85c1808"}
Sep 19 04:14:07.300731 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:07.300698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4tvx" event={"ID":"ece9e24c-990e-4be0-ba4f-b5180d777b82","Type":"ContainerStarted","Data":"fc04df285ccde427bb99bd10ed84ce70c006791488ef3ad6f343ad15f4058f90"}
Sep 19 04:14:08.094208 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:08.094170    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:08.094394 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:08.094371    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:08.094394 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:08.094390    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:08.094488 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:08.094457    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:10.09443658 +0000 UTC m=+38.628418014 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:08.195583 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:08.195542    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:08.195748 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:08.195724    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:08.195822 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:08.195809    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:10.19578852 +0000 UTC m=+38.729769950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:08.306748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:08.306713    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="6b63614631f5729beb58c33f26df713de74b8d6b2896fd9b2a68e835d85c1808" exitCode=0
Sep 19 04:14:08.307169 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:08.306778    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"6b63614631f5729beb58c33f26df713de74b8d6b2896fd9b2a68e835d85c1808"}
Sep 19 04:14:09.312394 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:09.312362    2584 generic.go:356] "Generic (PLEG): container finished" podID="6b21252f-30c8-419f-9303-d74919b5c777" containerID="efad193bf5a0dc43d4a1d645ba2643b5ee00eb1c55faa4770b84dbeb494ce4e0" exitCode=0
Sep 19 04:14:09.312799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:09.312407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerDied","Data":"efad193bf5a0dc43d4a1d645ba2643b5ee00eb1c55faa4770b84dbeb494ce4e0"}
Sep 19 04:14:10.112356 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:10.112152    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:10.112547 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:10.112326    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:10.112547 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:10.112436    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:10.112547 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:10.112491    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:14.112477132 +0000 UTC m=+42.646458561 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:10.212994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:10.212963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:10.213119 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:10.213071    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:10.213170 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:10.213120    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:14.213104551 +0000 UTC m=+42.747085980 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:10.316660 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:10.316629    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r4tvx" event={"ID":"ece9e24c-990e-4be0-ba4f-b5180d777b82","Type":"ContainerStarted","Data":"16b5d272aaca84efadf15e6a35530ec5fde88604639ce42c68c53c7b7fe8556e"}
Sep 19 04:14:10.319970 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:10.319942    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" event={"ID":"6b21252f-30c8-419f-9303-d74919b5c777","Type":"ContainerStarted","Data":"a4da269f2e4f034ca4599f50c46e862f02375fbd4d5b631613421033217cc1ed"}
Sep 19 04:14:10.356858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:10.356813    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r4tvx" podStartSLOduration=1.883069051 podStartE2EDuration="4.356798546s" totalImagesPullingTime="2.473729495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:10.356448836 +0000 UTC m=+38.890430274" watchObservedRunningTime="2026-09-19 04:14:10.356798546 +0000 UTC m=+38.890779975"
Sep 19 04:14:14.139025 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:14.138982    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:14.139422 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:14.139138    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:14.139422 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:14.139156    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:14.139422 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:14.139210    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:22.139194546 +0000 UTC m=+50.673175961 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:14.239766 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:14.239725    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:14.239911 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:14.239829    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:14.239911 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:14.239881    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:22.239869298 +0000 UTC m=+50.773850713 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:22.196058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:22.196014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:22.196802 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:22.196160    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:22.196802 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:22.196181    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:22.196802 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:22.196244    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:14:38.196230117 +0000 UTC m=+66.730211533 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:22.296395 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:22.296366    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:22.296531 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:22.296514    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:22.296592 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:22.296582    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:14:38.296565901 +0000 UTC m=+66.830547333 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:29.551711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.551644    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zl4rd" podStartSLOduration=27.97381695 podStartE2EDuration="57.551628607s" totalImagesPullingTime="29.577811657s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:10.432749963 +0000 UTC m=+38.966731411" watchObservedRunningTime="2026-09-19 04:14:29.551628607 +0000 UTC m=+58.085610045"
Sep 19 04:14:29.552297 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.552260    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c2ksd"]
Sep 19 04:14:29.580635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.580611    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.610397 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.610372    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 19 04:14:29.610510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.610408    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 19 04:14:29.610920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.610907    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 19 04:14:29.611211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.611198    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 19 04:14:29.612711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.612695    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2ksd"]
Sep 19 04:14:29.620440 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.620409    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mt2jg\""
Sep 19 04:14:29.748067 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.748032    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.748226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.748081    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-crio-socket\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.748226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.748099    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-data-volume\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.748226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.748161    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnz2n\" (UniqueName: \"kubernetes.io/projected/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-api-access-mnz2n\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.748226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.748186    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849147 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849085    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnz2n\" (UniqueName: \"kubernetes.io/projected/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-api-access-mnz2n\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849147 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849118    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849166    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-crio-socket\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849212    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-data-volume\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849310    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-crio-socket\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:29.849322    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:29.849357 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:29.849346    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:29.849582 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:29.849417    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:30.349394908 +0000 UTC m=+58.883376324 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:29.849582 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:29.849437    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:30.349428077 +0000 UTC m=+58.883409501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:29.849582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.849491    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-data-volume\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:29.860768 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:29.860742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnz2n\" (UniqueName: \"kubernetes.io/projected/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-api-access-mnz2n\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:30.353069 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:30.353033    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:30.353228 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:30.353097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:30.353228 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:30.353167    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:30.353228 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:30.353184    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:30.353228 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:30.353218    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:31.353203755 +0000 UTC m=+59.887185171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:30.353434 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:30.353251    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:31.353238457 +0000 UTC m=+59.887219874 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:31.361536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:31.361489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:31.361930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:31.361567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:31.361930 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:31.361630    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:31.361930 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:31.361637    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:31.361930 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:31.361682    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:33.361667739 +0000 UTC m=+61.895649156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:31.361930 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:31.361695    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:33.361688414 +0000 UTC m=+61.895669830 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:31.662119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:31.662043    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nftcf_3ea72195-43ff-4484-886c-739fa5878e2e/dns-node-resolver/0.log"
Sep 19 04:14:32.295290 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:32.295248    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hnkqc"
Sep 19 04:14:32.462814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:32.462792    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmnnf_bc83c9f3-f699-4e99-8efb-b686472aee5e/node-ca/0.log"
Sep 19 04:14:33.273821 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:33.273793    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4tvx_ece9e24c-990e-4be0-ba4f-b5180d777b82/serve-healthcheck-canary/0.log"
Sep 19 04:14:33.378154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:33.378126    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:33.378308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:33.378190    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:33.378308 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:33.378241    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:33.378383 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:33.378319    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.378304227 +0000 UTC m=+65.912285653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:33.378383 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:33.378319    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:33.378383 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:33.378362    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:37.378349574 +0000 UTC m=+65.912330990 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:35.478690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.478660    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zj8pr"]
Sep 19 04:14:35.481987 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.481970    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.485116 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.485091    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 19 04:14:35.485206 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.485182    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-c2zcg\""
Sep 19 04:14:35.485674 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.485658    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:35.485965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.485944    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 19 04:14:35.487969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.487950    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 19 04:14:35.492513 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.492496    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 19 04:14:35.493917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.493895    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zj8pr"]
Sep 19 04:14:35.594815 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.594775    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-trusted-ca\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.594984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.594883    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e563010-443f-431f-95a4-e94696381c84-serving-cert\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.594984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.594939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-config\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.594984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.594977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-st62j\" (UniqueName: \"kubernetes.io/projected/8e563010-443f-431f-95a4-e94696381c84-kube-api-access-st62j\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.696146 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.696116    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-trusted-ca\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.696216 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.696189    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e563010-443f-431f-95a4-e94696381c84-serving-cert\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.696257 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.696228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-config\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.696319 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.696270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-st62j\" (UniqueName: \"kubernetes.io/projected/8e563010-443f-431f-95a4-e94696381c84-kube-api-access-st62j\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.696858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.696834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-config\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.697062 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.697045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8e563010-443f-431f-95a4-e94696381c84-trusted-ca\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.698712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.698694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8e563010-443f-431f-95a4-e94696381c84-serving-cert\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.705937 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.705915    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-st62j\" (UniqueName: \"kubernetes.io/projected/8e563010-443f-431f-95a4-e94696381c84-kube-api-access-st62j\") pod \"console-operator-fd4bb46c-zj8pr\" (UID: \"8e563010-443f-431f-95a4-e94696381c84\") " pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:35.790366 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:35.790346    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:36.059287 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:36.059193    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-fd4bb46c-zj8pr"]
Sep 19 04:14:36.062352 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:36.062322    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e563010_443f_431f_95a4_e94696381c84.slice/crio-6694a0accd9b5d2415481a2ab0fdb5ec949993fda59e25986a68b9329bd49f1d WatchSource:0}: Error finding container 6694a0accd9b5d2415481a2ab0fdb5ec949993fda59e25986a68b9329bd49f1d: Status 404 returned error can't find the container with id 6694a0accd9b5d2415481a2ab0fdb5ec949993fda59e25986a68b9329bd49f1d
Sep 19 04:14:36.383168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:36.383084    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" event={"ID":"8e563010-443f-431f-95a4-e94696381c84","Type":"ContainerStarted","Data":"6694a0accd9b5d2415481a2ab0fdb5ec949993fda59e25986a68b9329bd49f1d"}
Sep 19 04:14:37.408817 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.408791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:37.409172 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.408849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:37.409172 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.408945    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 19 04:14:37.409172 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.408947    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:37.409172 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.408998    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:45.408984053 +0000 UTC m=+73.942965469 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:37.409172 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.409012    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:14:45.409005471 +0000 UTC m=+73.942986886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : configmap "kube-rbac-proxy" not found
Sep 19 04:14:37.609620 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.609581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:37.612314 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.612290    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 19 04:14:37.623137 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.623104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f88126a7-6010-4997-a008-a1fabdb0e621-original-pull-secret\") pod \"global-pull-secret-syncer-pp4mx\" (UID: \"f88126a7-6010-4997-a008-a1fabdb0e621\") " pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:37.710298 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.710197    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:14:37.710298 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.710259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:37.712985 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.712959    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 19 04:14:37.712985 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.712975    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 19 04:14:37.721044 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.721016    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 19 04:14:37.721143 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:37.721108    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs podName:b5262ca8-5acb-4c3b-8b47-722259900eab nodeName:}" failed. No retries permitted until 2026-09-19 04:15:41.72108508 +0000 UTC m=+130.255066520 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs") pod "network-metrics-daemon-5tz5c" (UID: "b5262ca8-5acb-4c3b-8b47-722259900eab") : secret "metrics-daemon-secret" not found
Sep 19 04:14:37.723168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.723146    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 19 04:14:37.734908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.734886    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zq9s2\" (UniqueName: \"kubernetes.io/projected/3a5d895d-fcbd-441e-8839-2943bba2143f-kube-api-access-zq9s2\") pod \"network-check-target-68wfb\" (UID: \"3a5d895d-fcbd-441e-8839-2943bba2143f\") " pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:37.873564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.873535    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rwkvg\""
Sep 19 04:14:37.881853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.881829    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:37.884109 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:37.884085    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-pp4mx"
Sep 19 04:14:38.214724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.214688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:14:38.214907 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:38.214852    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 19 04:14:38.214907 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:38.214871    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-866988c6-5vsk2: secret "image-registry-tls" not found
Sep 19 04:14:38.214989 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:38.214926    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls podName:9724ae83-2f16-43dd-ac2d-dc5c1299094b nodeName:}" failed. No retries permitted until 2026-09-19 04:15:10.214909125 +0000 UTC m=+98.748890541 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls") pod "image-registry-866988c6-5vsk2" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b") : secret "image-registry-tls" not found
Sep 19 04:14:38.258449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.258387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-pp4mx"]
Sep 19 04:14:38.261177 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:38.261147    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf88126a7_6010_4997_a008_a1fabdb0e621.slice/crio-b141748fb30b5bdc23ffc4cf98f9186e559373ad62117e5d91f3b1a0d97aac1c WatchSource:0}: Error finding container b141748fb30b5bdc23ffc4cf98f9186e559373ad62117e5d91f3b1a0d97aac1c: Status 404 returned error can't find the container with id b141748fb30b5bdc23ffc4cf98f9186e559373ad62117e5d91f3b1a0d97aac1c
Sep 19 04:14:38.265682 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.261718    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-68wfb"]
Sep 19 04:14:38.265682 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:38.265384    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a5d895d_fcbd_441e_8839_2943bba2143f.slice/crio-b79f8a168012543e917e06e87939044c31c74951b7096307db77f2a634d75a57 WatchSource:0}: Error finding container b79f8a168012543e917e06e87939044c31c74951b7096307db77f2a634d75a57: Status 404 returned error can't find the container with id b79f8a168012543e917e06e87939044c31c74951b7096307db77f2a634d75a57
Sep 19 04:14:38.315776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.315753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:14:38.315892 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:38.315845    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 19 04:14:38.315892 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:38.315887    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls podName:637b5af8-6cff-4d78-8940-52349943c82f nodeName:}" failed. No retries permitted until 2026-09-19 04:15:10.315874883 +0000 UTC m=+98.849856300 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls") pod "dns-default-lx2tb" (UID: "637b5af8-6cff-4d78-8940-52349943c82f") : secret "dns-default-metrics-tls" not found
Sep 19 04:14:38.389172 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.389139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pp4mx" event={"ID":"f88126a7-6010-4997-a008-a1fabdb0e621","Type":"ContainerStarted","Data":"b141748fb30b5bdc23ffc4cf98f9186e559373ad62117e5d91f3b1a0d97aac1c"}
Sep 19 04:14:38.390652 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.390629    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/0.log"
Sep 19 04:14:38.390732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.390664    2584 generic.go:356] "Generic (PLEG): container finished" podID="8e563010-443f-431f-95a4-e94696381c84" containerID="34e58a69bcf76c9d570894a01b8486a763d2b8e1b3cc8348bfc9e6047927f3c9" exitCode=255
Sep 19 04:14:38.390732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.390724    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" event={"ID":"8e563010-443f-431f-95a4-e94696381c84","Type":"ContainerDied","Data":"34e58a69bcf76c9d570894a01b8486a763d2b8e1b3cc8348bfc9e6047927f3c9"}
Sep 19 04:14:38.390945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.390921    2584 scope.go:117] "RemoveContainer" containerID="34e58a69bcf76c9d570894a01b8486a763d2b8e1b3cc8348bfc9e6047927f3c9"
Sep 19 04:14:38.391833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:38.391814    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68wfb" event={"ID":"3a5d895d-fcbd-441e-8839-2943bba2143f","Type":"ContainerStarted","Data":"b79f8a168012543e917e06e87939044c31c74951b7096307db77f2a634d75a57"}
Sep 19 04:14:39.396951 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.396921    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/1.log"
Sep 19 04:14:39.397474 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.397456    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/0.log"
Sep 19 04:14:39.397542 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.397494    2584 generic.go:356] "Generic (PLEG): container finished" podID="8e563010-443f-431f-95a4-e94696381c84" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0" exitCode=255
Sep 19 04:14:39.397596 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.397562    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" event={"ID":"8e563010-443f-431f-95a4-e94696381c84","Type":"ContainerDied","Data":"c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"}
Sep 19 04:14:39.397649 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.397611    2584 scope.go:117] "RemoveContainer" containerID="34e58a69bcf76c9d570894a01b8486a763d2b8e1b3cc8348bfc9e6047927f3c9"
Sep 19 04:14:39.397965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:39.397944    2584 scope.go:117] "RemoveContainer" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"
Sep 19 04:14:39.398122 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:39.398102    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:14:40.403764 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:40.403736    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/1.log"
Sep 19 04:14:40.404226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:40.404101    2584 scope.go:117] "RemoveContainer" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"
Sep 19 04:14:40.404323 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:40.404301    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:14:41.410634 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.410601    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"]
Sep 19 04:14:41.413782 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.413763    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"
Sep 19 04:14:41.435311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.435161    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 19 04:14:41.435311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.435183    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 19 04:14:41.435859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.435842    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-pzrl8\""
Sep 19 04:14:41.441391 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.441364    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjnrr\" (UniqueName: \"kubernetes.io/projected/770e17ab-6540-41a7-814a-4241f91c7541-kube-api-access-vjnrr\") pod \"migrator-76794cbd6c-6rzrr\" (UID: \"770e17ab-6540-41a7-814a-4241f91c7541\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"
Sep 19 04:14:41.468866 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.468839    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"]
Sep 19 04:14:41.542306 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.542214    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjnrr\" (UniqueName: \"kubernetes.io/projected/770e17ab-6540-41a7-814a-4241f91c7541-kube-api-access-vjnrr\") pod \"migrator-76794cbd6c-6rzrr\" (UID: \"770e17ab-6540-41a7-814a-4241f91c7541\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"
Sep 19 04:14:41.572710 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.572679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjnrr\" (UniqueName: \"kubernetes.io/projected/770e17ab-6540-41a7-814a-4241f91c7541-kube-api-access-vjnrr\") pod \"migrator-76794cbd6c-6rzrr\" (UID: \"770e17ab-6540-41a7-814a-4241f91c7541\") " pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"
Sep 19 04:14:41.723196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:41.723102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"
Sep 19 04:14:42.541488 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.541398    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"]
Sep 19 04:14:42.545464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.545444    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.548733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.548710    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.548821 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.548772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3b8c698-7c35-4cef-b894-7c7e9529e287-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.549937 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.549917    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 19 04:14:42.550035 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.549991    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-h277m\""
Sep 19 04:14:42.550739 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.550723    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 19 04:14:42.567693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.567665    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"]
Sep 19 04:14:42.649669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.649645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.649791 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.649705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3b8c698-7c35-4cef-b894-7c7e9529e287-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.649791 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:42.649753    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 04:14:42.649896 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:42.649829    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert podName:d3b8c698-7c35-4cef-b894-7c7e9529e287 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:43.149804908 +0000 UTC m=+71.683786325 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5k9xj" (UID: "d3b8c698-7c35-4cef-b894-7c7e9529e287") : secret "networking-console-plugin-cert" not found
Sep 19 04:14:42.650259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.650240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d3b8c698-7c35-4cef-b894-7c7e9529e287-nginx-conf\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:42.806063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:42.806040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr"]
Sep 19 04:14:42.810207 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:42.810180    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod770e17ab_6540_41a7_814a_4241f91c7541.slice/crio-1987229c8ae0bf113f5beafd66e371913ac62ebd1fc0287f9e663257590b0e16 WatchSource:0}: Error finding container 1987229c8ae0bf113f5beafd66e371913ac62ebd1fc0287f9e663257590b0e16: Status 404 returned error can't find the container with id 1987229c8ae0bf113f5beafd66e371913ac62ebd1fc0287f9e663257590b0e16
Sep 19 04:14:43.153159 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.153065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:43.153364 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:43.153233    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 04:14:43.153364 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:43.153339    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert podName:d3b8c698-7c35-4cef-b894-7c7e9529e287 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:44.153317753 +0000 UTC m=+72.687299172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5k9xj" (UID: "d3b8c698-7c35-4cef-b894-7c7e9529e287") : secret "networking-console-plugin-cert" not found
Sep 19 04:14:43.413688 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.413613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-pp4mx" event={"ID":"f88126a7-6010-4997-a008-a1fabdb0e621","Type":"ContainerStarted","Data":"ac9ce99c4aa6a3f8fff27cef0f70071a525df0a5aa871a93ece4577ec198fc6c"}
Sep 19 04:14:43.415733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.415628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-68wfb" event={"ID":"3a5d895d-fcbd-441e-8839-2943bba2143f","Type":"ContainerStarted","Data":"b1c6324f0a00ced55448ee5c272164ba1939ab38015dd66927c38fa85cd9237c"}
Sep 19 04:14:43.415733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.415689    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:14:43.416868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.416845    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr" event={"ID":"770e17ab-6540-41a7-814a-4241f91c7541","Type":"ContainerStarted","Data":"1987229c8ae0bf113f5beafd66e371913ac62ebd1fc0287f9e663257590b0e16"}
Sep 19 04:14:43.445763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.445725    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-pp4mx" podStartSLOduration=67.122877607 podStartE2EDuration="1m11.445711098s" totalImagesPullingTime="4.322833491s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:43.445034282 +0000 UTC m=+71.979015722" watchObservedRunningTime="2026-09-19 04:14:43.445711098 +0000 UTC m=+71.979692530"
Sep 19 04:14:43.470549 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:43.470493    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-68wfb" podStartSLOduration=67.197657346 podStartE2EDuration="1m11.470475198s" totalImagesPullingTime="4.272817852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:43.469900462 +0000 UTC m=+72.003881913" watchObservedRunningTime="2026-09-19 04:14:43.470475198 +0000 UTC m=+72.004456638"
Sep 19 04:14:44.160946 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:44.160906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:44.161362 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:44.161021    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 04:14:44.161362 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:44.161099    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert podName:d3b8c698-7c35-4cef-b894-7c7e9529e287 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:46.161076441 +0000 UTC m=+74.695057873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5k9xj" (UID: "d3b8c698-7c35-4cef-b894-7c7e9529e287") : secret "networking-console-plugin-cert" not found
Sep 19 04:14:44.422694 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:44.422607    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr" event={"ID":"770e17ab-6540-41a7-814a-4241f91c7541","Type":"ContainerStarted","Data":"01d50216d12f3e3696cd9195fab65a5f376d2c47ca8dfa4092f8f445f6b3e909"}
Sep 19 04:14:44.422694 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:44.422670    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr" event={"ID":"770e17ab-6540-41a7-814a-4241f91c7541","Type":"ContainerStarted","Data":"1a3f864898aeb6da689195e7fcf50df9b6c840c330282c187b224f626558e8c6"}
Sep 19 04:14:44.449622 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:44.449576    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-76794cbd6c-6rzrr" podStartSLOduration=2.502135934 podStartE2EDuration="3.449562085s" totalImagesPullingTime="947.426151ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:14:44.448574538 +0000 UTC m=+72.982555967" watchObservedRunningTime="2026-09-19 04:14:44.449562085 +0000 UTC m=+72.983543522"
Sep 19 04:14:45.470857 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.470822    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:45.471220 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.470903    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:45.471220 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:45.470991    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:45.471220 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:45.471045    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls podName:d5bf6c9b-1e27-4443-b4e4-557b3b78d70c nodeName:}" failed. No retries permitted until 2026-09-19 04:15:01.471029722 +0000 UTC m=+90.005011143 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c2ksd" (UID: "d5bf6c9b-1e27-4443-b4e4-557b3b78d70c") : secret "insights-runtime-extractor-tls" not found
Sep 19 04:14:45.471381 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.471362    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:14:45.791155 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.791130    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:45.791312 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.791206    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:14:45.791529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:45.791517    2584 scope.go:117] "RemoveContainer" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"
Sep 19 04:14:45.791671 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:45.791653    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:14:46.176458 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:46.176373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:46.176627 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:46.176521    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 04:14:46.176627 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:46.176587    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert podName:d3b8c698-7c35-4cef-b894-7c7e9529e287 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:50.176571697 +0000 UTC m=+78.710553112 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5k9xj" (UID: "d3b8c698-7c35-4cef-b894-7c7e9529e287") : secret "networking-console-plugin-cert" not found
Sep 19 04:14:50.206880 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:50.206763    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:50.206880 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:50.206864    2584 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 19 04:14:50.207261 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:14:50.206919    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert podName:d3b8c698-7c35-4cef-b894-7c7e9529e287 nodeName:}" failed. No retries permitted until 2026-09-19 04:14:58.206904667 +0000 UTC m=+86.740886083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert") pod "networking-console-plugin-6446c8d75d-5k9xj" (UID: "d3b8c698-7c35-4cef-b894-7c7e9529e287") : secret "networking-console-plugin-cert" not found
Sep 19 04:14:58.266291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:58.266249    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:58.268885 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:58.268859    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d3b8c698-7c35-4cef-b894-7c7e9529e287-networking-console-plugin-cert\") pod \"networking-console-plugin-6446c8d75d-5k9xj\" (UID: \"d3b8c698-7c35-4cef-b894-7c7e9529e287\") " pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:58.455447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:58.455404    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"
Sep 19 04:14:58.732698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:58.732668    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj"]
Sep 19 04:14:58.735826 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:14:58.735795    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b8c698_7c35_4cef_b894_7c7e9529e287.slice/crio-28c90f15f019120e9f43fcb6f8bf98adc68384803d1afee7a979cecfae0dd130 WatchSource:0}: Error finding container 28c90f15f019120e9f43fcb6f8bf98adc68384803d1afee7a979cecfae0dd130: Status 404 returned error can't find the container with id 28c90f15f019120e9f43fcb6f8bf98adc68384803d1afee7a979cecfae0dd130
Sep 19 04:14:59.469538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:59.469507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj" event={"ID":"d3b8c698-7c35-4cef-b894-7c7e9529e287","Type":"ContainerStarted","Data":"28c90f15f019120e9f43fcb6f8bf98adc68384803d1afee7a979cecfae0dd130"}
Sep 19 04:14:59.961951 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:14:59.961914    2584 scope.go:117] "RemoveContainer" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"
Sep 19 04:15:00.473676 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.473648    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:15:00.474078 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.474063    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/1.log"
Sep 19 04:15:00.474131 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.474096    2584 generic.go:356] "Generic (PLEG): container finished" podID="8e563010-443f-431f-95a4-e94696381c84" containerID="9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751" exitCode=255
Sep 19 04:15:00.474176 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.474159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" event={"ID":"8e563010-443f-431f-95a4-e94696381c84","Type":"ContainerDied","Data":"9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751"}
Sep 19 04:15:00.474230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.474218    2584 scope.go:117] "RemoveContainer" containerID="c92940d0f33b07ede1aade4cb8a36a0f94342177801b1f326f5538ae5bb293f0"
Sep 19 04:15:00.474527 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.474512    2584 scope.go:117] "RemoveContainer" containerID="9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751"
Sep 19 04:15:00.474728 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:00.474700    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:15:00.475790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.475769    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj" event={"ID":"d3b8c698-7c35-4cef-b894-7c7e9529e287","Type":"ContainerStarted","Data":"8f01446ad89721dd316f4fdc178fa8c6027a5d04e0c7ac3d13fad143b95eee97"}
Sep 19 04:15:00.517851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:00.517807    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6446c8d75d-5k9xj" podStartSLOduration=17.629123721 podStartE2EDuration="18.517794906s" totalImagesPullingTime="888.671185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:00.517018407 +0000 UTC m=+89.050999844" watchObservedRunningTime="2026-09-19 04:15:00.517794906 +0000 UTC m=+89.051776343"
Sep 19 04:15:01.480536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.480503    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:15:01.491095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.491069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:15:01.493452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.493435    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d5bf6c9b-1e27-4443-b4e4-557b3b78d70c-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c2ksd\" (UID: \"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c\") " pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:15:01.692245 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.692215    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mt2jg\""
Sep 19 04:15:01.699820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.699799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c2ksd"
Sep 19 04:15:01.989871 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:01.989842    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5bf6c9b_1e27_4443_b4e4_557b3b78d70c.slice/crio-d11a6a5725e984af2836d10d90ea3c2f60c3c519a98fbbd9cb413be92ecd8437 WatchSource:0}: Error finding container d11a6a5725e984af2836d10d90ea3c2f60c3c519a98fbbd9cb413be92ecd8437: Status 404 returned error can't find the container with id d11a6a5725e984af2836d10d90ea3c2f60c3c519a98fbbd9cb413be92ecd8437
Sep 19 04:15:01.994322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:01.990495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c2ksd"]
Sep 19 04:15:02.484928 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:02.484895    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2ksd" event={"ID":"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c","Type":"ContainerStarted","Data":"c07f5d59a55b0263fb3c2288de65aeadcbadcb56159632c01c9d824e2238dfbd"}
Sep 19 04:15:02.485326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:02.484974    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2ksd" event={"ID":"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c","Type":"ContainerStarted","Data":"d11a6a5725e984af2836d10d90ea3c2f60c3c519a98fbbd9cb413be92ecd8437"}
Sep 19 04:15:03.490952 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:03.490918    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2ksd" event={"ID":"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c","Type":"ContainerStarted","Data":"41a1295fde2bed78409aca98d6148999a9e4f7e22c88ad36dd231103afaa8d7f"}
Sep 19 04:15:04.495471 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:04.495372    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c2ksd" event={"ID":"d5bf6c9b-1e27-4443-b4e4-557b3b78d70c","Type":"ContainerStarted","Data":"687b39c6b02bec7fe589338011167d6d1d47deccde37fb6c19084ad794567325"}
Sep 19 04:15:04.520095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:04.520042    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c2ksd" podStartSLOduration=33.528583694 podStartE2EDuration="35.520028852s" totalImagesPullingTime="1.991445158s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 04:14:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:04.518724236 +0000 UTC m=+93.052705673" watchObservedRunningTime="2026-09-19 04:15:04.520028852 +0000 UTC m=+93.054010290"
Sep 19 04:15:05.790612 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:05.790566    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:15:05.791112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:05.790638    2584 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:15:05.791112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:05.790989    2584 scope.go:117] "RemoveContainer" containerID="9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751"
Sep 19 04:15:05.791230 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:05.791175    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:15:07.024213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.023243    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"]
Sep 19 04:15:07.027685 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.027653    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.032778 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:07.032751    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"work-manager-hub-kubeconfig\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" type="*v1.Secret"
Sep 19 04:15:07.032919 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:07.032887    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"open-cluster-management-image-pull-credentials\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" type="*v1.Secret"
Sep 19 04:15:07.032989 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:07.032961    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 19 04:15:07.032989 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:07.032964    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" podUID="1bb27183-eefa-4f7f-9506-cc5414c9571f" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.035166 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:07.035125    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"open-cluster-management-agent-addon\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 19 04:15:07.076320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.076287    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"]
Sep 19 04:15:07.132799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.132764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1bb27183-eefa-4f7f-9506-cc5414c9571f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.132967 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.132852    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfbtr\" (UniqueName: \"kubernetes.io/projected/1bb27183-eefa-4f7f-9506-cc5414c9571f-kube-api-access-pfbtr\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.132967 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.132875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bb27183-eefa-4f7f-9506-cc5414c9571f-tmp\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.233490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.233458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1bb27183-eefa-4f7f-9506-cc5414c9571f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.233664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.233576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfbtr\" (UniqueName: \"kubernetes.io/projected/1bb27183-eefa-4f7f-9506-cc5414c9571f-kube-api-access-pfbtr\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.233664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.233604    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bb27183-eefa-4f7f-9506-cc5414c9571f-tmp\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.234030 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.234011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1bb27183-eefa-4f7f-9506-cc5414c9571f-tmp\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:07.972920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:07.972891    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 19 04:15:08.028284 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.028248    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 19 04:15:08.036556 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.036535    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1bb27183-eefa-4f7f-9506-cc5414c9571f-klusterlet-config\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:08.069566 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.069539    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 19 04:15:08.079059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.079029    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfbtr\" (UniqueName: \"kubernetes.io/projected/1bb27183-eefa-4f7f-9506-cc5414c9571f-kube-api-access-pfbtr\") pod \"klusterlet-addon-workmgr-7b87b8cc7b-m2t4m\" (UID: \"1bb27183-eefa-4f7f-9506-cc5414c9571f\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:08.108761 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.108727    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 19 04:15:08.238816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.238750    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:08.514974 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:08.514953    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"]
Sep 19 04:15:08.517142 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:08.517108    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bb27183_eefa_4f7f_9506_cc5414c9571f.slice/crio-e4b83d22f649711c27171a7176ad76fb527cb0130c38579f02bb6491e8bf2aec WatchSource:0}: Error finding container e4b83d22f649711c27171a7176ad76fb527cb0130c38579f02bb6491e8bf2aec: Status 404 returned error can't find the container with id e4b83d22f649711c27171a7176ad76fb527cb0130c38579f02bb6491e8bf2aec
Sep 19 04:15:09.511373 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.511339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m" event={"ID":"1bb27183-eefa-4f7f-9506-cc5414c9571f","Type":"ContainerStarted","Data":"e4b83d22f649711c27171a7176ad76fb527cb0130c38579f02bb6491e8bf2aec"}
Sep 19 04:15:09.551858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.551826    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"]
Sep 19 04:15:09.556154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.556129    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.561933 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.561672    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 19 04:15:09.561933 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.561671    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 19 04:15:09.561933 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.561735    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 19 04:15:09.562548 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.562525    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 19 04:15:09.562808 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.562794    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cxwvf\""
Sep 19 04:15:09.563068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.563054    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 19 04:15:09.568350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.568327    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"]
Sep 19 04:15:09.655408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.655368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfjqq\" (UniqueName: \"kubernetes.io/projected/9a79bfb2-4ab1-4332-8230-e725f7430454-kube-api-access-zfjqq\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.655654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.655473    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79bfb2-4ab1-4332-8230-e725f7430454-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.655654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.655516    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.655765 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.655657    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.756937 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.756907    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.757119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.756971    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.757119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.757015    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfjqq\" (UniqueName: \"kubernetes.io/projected/9a79bfb2-4ab1-4332-8230-e725f7430454-kube-api-access-zfjqq\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.757119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.757058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79bfb2-4ab1-4332-8230-e725f7430454-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.757312 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:09.757133    2584 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 19 04:15:09.757312 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:09.757207    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls podName:9a79bfb2-4ab1-4332-8230-e725f7430454 nodeName:}" failed. No retries permitted until 2026-09-19 04:15:10.257186933 +0000 UTC m=+98.791168354 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls") pod "prometheus-operator-7bd5d56d6-4z2d2" (UID: "9a79bfb2-4ab1-4332-8230-e725f7430454") : secret "prometheus-operator-tls" not found
Sep 19 04:15:09.758013 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.757986    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9a79bfb2-4ab1-4332-8230-e725f7430454-metrics-client-ca\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.759919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.759888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:09.776859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:09.776802    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfjqq\" (UniqueName: \"kubernetes.io/projected/9a79bfb2-4ab1-4332-8230-e725f7430454-kube-api-access-zfjqq\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:10.261483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.261419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:10.261656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.261494    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:10.264326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.264298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9a79bfb2-4ab1-4332-8230-e725f7430454-prometheus-operator-tls\") pod \"prometheus-operator-7bd5d56d6-4z2d2\" (UID: \"9a79bfb2-4ab1-4332-8230-e725f7430454\") " pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:10.264549 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.264527    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"image-registry-866988c6-5vsk2\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") " pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:10.297427 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.297402    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tnxhx\""
Sep 19 04:15:10.305807 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.305600    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:10.362021 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.361983    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:15:10.364808 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.364783    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/637b5af8-6cff-4d78-8940-52349943c82f-metrics-tls\") pod \"dns-default-lx2tb\" (UID: \"637b5af8-6cff-4d78-8940-52349943c82f\") " pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:15:10.469148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.469108    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"
Sep 19 04:15:10.659523 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.659492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5s7cn\""
Sep 19 04:15:10.667444 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:10.667413    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:15:11.036953 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.036926    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2"]
Sep 19 04:15:11.039341 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:11.039312    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a79bfb2_4ab1_4332_8230_e725f7430454.slice/crio-78e4e82cb160858234f3ce1ce0d731fc77c1203826a7148a7e1c6045d36fa94b WatchSource:0}: Error finding container 78e4e82cb160858234f3ce1ce0d731fc77c1203826a7148a7e1c6045d36fa94b: Status 404 returned error can't find the container with id 78e4e82cb160858234f3ce1ce0d731fc77c1203826a7148a7e1c6045d36fa94b
Sep 19 04:15:11.042400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.042328    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lx2tb"]
Sep 19 04:15:11.043392 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.043366    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:15:11.045923 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:11.045903    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod637b5af8_6cff_4d78_8940_52349943c82f.slice/crio-e30156ea964fb88973705df6c54fce051dae1efc45fa2b4c5f94f864bef90512 WatchSource:0}: Error finding container e30156ea964fb88973705df6c54fce051dae1efc45fa2b4c5f94f864bef90512: Status 404 returned error can't find the container with id e30156ea964fb88973705df6c54fce051dae1efc45fa2b4c5f94f864bef90512
Sep 19 04:15:11.047947 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:11.047926    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9724ae83_2f16_43dd_ac2d_dc5c1299094b.slice/crio-5fed48b8913675338997191d7c4acf8d5c3839af6e4ca41e2329c776578b5431 WatchSource:0}: Error finding container 5fed48b8913675338997191d7c4acf8d5c3839af6e4ca41e2329c776578b5431: Status 404 returned error can't find the container with id 5fed48b8913675338997191d7c4acf8d5c3839af6e4ca41e2329c776578b5431
Sep 19 04:15:11.521260 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.521164    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lx2tb" event={"ID":"637b5af8-6cff-4d78-8940-52349943c82f","Type":"ContainerStarted","Data":"e30156ea964fb88973705df6c54fce051dae1efc45fa2b4c5f94f864bef90512"}
Sep 19 04:15:11.522670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.522642    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2" event={"ID":"9a79bfb2-4ab1-4332-8230-e725f7430454","Type":"ContainerStarted","Data":"78e4e82cb160858234f3ce1ce0d731fc77c1203826a7148a7e1c6045d36fa94b"}
Sep 19 04:15:11.524890 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.524863    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866988c6-5vsk2" event={"ID":"9724ae83-2f16-43dd-ac2d-dc5c1299094b","Type":"ContainerStarted","Data":"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"}
Sep 19 04:15:11.524986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.524902    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866988c6-5vsk2" event={"ID":"9724ae83-2f16-43dd-ac2d-dc5c1299094b","Type":"ContainerStarted","Data":"5fed48b8913675338997191d7c4acf8d5c3839af6e4ca41e2329c776578b5431"}
Sep 19 04:15:11.525097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.525082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:11.550324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:11.550261    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-866988c6-5vsk2" podStartSLOduration=98.550244996 podStartE2EDuration="1m38.550244996s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:11.54975225 +0000 UTC m=+100.083733689" watchObservedRunningTime="2026-09-19 04:15:11.550244996 +0000 UTC m=+100.084226434"
Sep 19 04:15:12.531409 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:12.531373    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m" event={"ID":"1bb27183-eefa-4f7f-9506-cc5414c9571f","Type":"ContainerStarted","Data":"35b1a4326430f8fc2ed685b556604617d2cc6f1df57f1c1deb4f086a67b4e8b3"}
Sep 19 04:15:12.531812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:12.531657    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:12.533210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:12.533184    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m"
Sep 19 04:15:12.555896 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:12.555816    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7b87b8cc7b-m2t4m" podStartSLOduration=2.770490637 podStartE2EDuration="6.555801005s" totalImagesPullingTime="3.785310368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:12.555062986 +0000 UTC m=+101.089044423" watchObservedRunningTime="2026-09-19 04:15:12.555801005 +0000 UTC m=+101.089782443"
Sep 19 04:15:14.425672 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.425639    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-68wfb"
Sep 19 04:15:14.538713 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.538682    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lx2tb" event={"ID":"637b5af8-6cff-4d78-8940-52349943c82f","Type":"ContainerStarted","Data":"8a8b8ca8bf1d1e07d31c7fda22040d8b36012b234fc173f8d20638369ab3bfe2"}
Sep 19 04:15:14.538881 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.538739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lx2tb" event={"ID":"637b5af8-6cff-4d78-8940-52349943c82f","Type":"ContainerStarted","Data":"fd01443a874ceea61e28d17267cd015bc3cf005a19b68c71c8ad16e90c7c9b5f"}
Sep 19 04:15:14.538881 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.538843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:15:14.540617 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.540591    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2" event={"ID":"9a79bfb2-4ab1-4332-8230-e725f7430454","Type":"ContainerStarted","Data":"8fde903da4b611866bae198dfc9e4c9c84e6cfaaf16a17b025895b6bfaeb72b8"}
Sep 19 04:15:14.540722 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.540638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2" event={"ID":"9a79bfb2-4ab1-4332-8230-e725f7430454","Type":"ContainerStarted","Data":"2b1cfa43d77fb20c28f0764a40fe7c4c62ed90e1eb8d01da926c06c87aea91b8"}
Sep 19 04:15:14.558945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.558903    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lx2tb" podStartSLOduration=66.042319929 podStartE2EDuration="1m8.558890452s" totalImagesPullingTime="2.516570523s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:14.55764656 +0000 UTC m=+103.091628010" watchObservedRunningTime="2026-09-19 04:15:14.558890452 +0000 UTC m=+103.092871910"
Sep 19 04:15:14.579789 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:14.579746    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7bd5d56d6-4z2d2" podStartSLOduration=3.064929502 podStartE2EDuration="5.579732756s" totalImagesPullingTime="2.514803254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:14.576761807 +0000 UTC m=+103.110743244" watchObservedRunningTime="2026-09-19 04:15:14.579732756 +0000 UTC m=+103.113714194"
Sep 19 04:15:17.686917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.686885    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s8z4k"]
Sep 19 04:15:17.700975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.700947    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.705215 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.705195    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rp7q2\""
Sep 19 04:15:17.705348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.705223    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 19 04:15:17.705348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.705308    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 19 04:15:17.705527 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.705515    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 19 04:15:17.823687 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823662    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-sys\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823829 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823694    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-wtmp\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823829 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823715    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823829 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-metrics-client-ca\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823829 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5s8\" (UniqueName: \"kubernetes.io/projected/d392229c-114d-4305-b0bf-d095cfd28235-kube-api-access-lx5s8\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823829 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-textfile\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823877    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-tls\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.823982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.823919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-root\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.924941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.924914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-sys\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.924941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.924944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-wtmp\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.924962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925024    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-sys\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925072    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-wtmp\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925077    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-metrics-client-ca\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925104    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5s8\" (UniqueName: \"kubernetes.io/projected/d392229c-114d-4305-b0bf-d095cfd28235-kube-api-access-lx5s8\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-textfile\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-tls\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-root\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925567 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925375    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d392229c-114d-4305-b0bf-d095cfd28235-root\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925619 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925576    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-textfile\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925640    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-metrics-client-ca\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.925670 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.925658    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-accelerators-collector-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.927872 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.927848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.927968 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.927849    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d392229c-114d-4305-b0bf-d095cfd28235-node-exporter-tls\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.952680 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.952633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5s8\" (UniqueName: \"kubernetes.io/projected/d392229c-114d-4305-b0bf-d095cfd28235-kube-api-access-lx5s8\") pod \"node-exporter-s8z4k\" (UID: \"d392229c-114d-4305-b0bf-d095cfd28235\") " pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:17.962230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:17.962208    2584 scope.go:117] "RemoveContainer" containerID="9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751"
Sep 19 04:15:17.962393 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:17.962375    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-fd4bb46c-zj8pr_openshift-console-operator(8e563010-443f-431f-95a4-e94696381c84)\"" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podUID="8e563010-443f-431f-95a4-e94696381c84"
Sep 19 04:15:18.009486 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.009457    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s8z4k"
Sep 19 04:15:18.053809 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:18.053788    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd392229c_114d_4305_b0bf_d095cfd28235.slice/crio-e1387b74a29b3048b9b1580b985417b83acf5606f9d1b5d4c65290751aa29af6 WatchSource:0}: Error finding container e1387b74a29b3048b9b1580b985417b83acf5606f9d1b5d4c65290751aa29af6: Status 404 returned error can't find the container with id e1387b74a29b3048b9b1580b985417b83acf5606f9d1b5d4c65290751aa29af6
Sep 19 04:15:18.554745 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.554704    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8z4k" event={"ID":"d392229c-114d-4305-b0bf-d095cfd28235","Type":"ContainerStarted","Data":"e1387b74a29b3048b9b1580b985417b83acf5606f9d1b5d4c65290751aa29af6"}
Sep 19 04:15:18.593016 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.592979    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:15:18.611536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.611505    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.620693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.620399    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 04:15:18.620693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.620452    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 04:15:18.620693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.620399    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 04:15:18.623803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.623779    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 04:15:18.623803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.623785    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 04:15:18.623803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.623807    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vlxvw\""
Sep 19 04:15:18.624060 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.623848    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 04:15:18.624169 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.624152    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 04:15:18.624224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.624191    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 04:15:18.624224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.624191    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 04:15:18.642655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.642629    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731546    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731642    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731664    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731699    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll75k\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731812    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.731860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731848    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.732640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731881    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.732640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731907    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.732640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731946    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.732640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.731974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.732640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.732007    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833138 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833059    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833138 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833333    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833428 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833407    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833481 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833438    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833515    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll75k\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833623 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833551    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833623 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833607    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833630    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.833724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833688    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.834000 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.833975    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.834183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.834127    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.834774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.834387    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.836774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.836742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.836882 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.836834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.837519 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.837497    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.837917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.837894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.838053 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.838033    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.838259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.838236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.838505 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.838484    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.838650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.838634    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.839119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.839102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.861370 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.861350    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll75k\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k\") pod \"alertmanager-main-0\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:18.922880 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:18.922850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:15:19.325211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:19.325176    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:15:19.328818 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:19.328787    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d94beb8_e82b_4873_ba68_1cd4fbd616a4.slice/crio-734b06ef4913ea15c1aa5ce3380677d51b990ecfe4b975e7a6c258e84e397107 WatchSource:0}: Error finding container 734b06ef4913ea15c1aa5ce3380677d51b990ecfe4b975e7a6c258e84e397107: Status 404 returned error can't find the container with id 734b06ef4913ea15c1aa5ce3380677d51b990ecfe4b975e7a6c258e84e397107
Sep 19 04:15:19.559754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:19.559728    2584 generic.go:356] "Generic (PLEG): container finished" podID="d392229c-114d-4305-b0bf-d095cfd28235" containerID="6371fc3ea42235f334267d15ef912a27c8a16f722c20fdc8c0a0041ef87b0385" exitCode=0
Sep 19 04:15:19.559930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:19.559826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8z4k" event={"ID":"d392229c-114d-4305-b0bf-d095cfd28235","Type":"ContainerDied","Data":"6371fc3ea42235f334267d15ef912a27c8a16f722c20fdc8c0a0041ef87b0385"}
Sep 19 04:15:19.561052 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:19.561023    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"734b06ef4913ea15c1aa5ce3380677d51b990ecfe4b975e7a6c258e84e397107"}
Sep 19 04:15:20.567031 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:20.567001    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8z4k" event={"ID":"d392229c-114d-4305-b0bf-d095cfd28235","Type":"ContainerStarted","Data":"5bf6aee5dbf49366215a649910b3e3ec5a25e524e0275ef26921e79a09a12bd6"}
Sep 19 04:15:20.567474 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:20.567055    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s8z4k" event={"ID":"d392229c-114d-4305-b0bf-d095cfd28235","Type":"ContainerStarted","Data":"3b9a5f05aa5300a3303c1d9c2c41100aa16f53764a4eaaa628baafb9deb08eb4"}
Sep 19 04:15:20.568666 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:20.568642    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a" exitCode=0
Sep 19 04:15:20.568777 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:20.568695    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"}
Sep 19 04:15:20.618092 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:20.617580    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s8z4k" podStartSLOduration=2.533801305 podStartE2EDuration="3.617561253s" totalImagesPullingTime="1.016823177s" totalInitContainerRuntime="66.936771ms" isStatefulPod=true podCreationTimestamp="2026-09-19 04:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:20.616104175 +0000 UTC m=+109.150085611" watchObservedRunningTime="2026-09-19 04:15:20.617561253 +0000 UTC m=+109.151542691"
Sep 19 04:15:21.321018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.320981    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-75877b7d76-7lp2n"]
Sep 19 04:15:21.324648 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.324609    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.328082 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.328059    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2fed1vfqt5qsa\""
Sep 19 04:15:21.328197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.328061    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 19 04:15:21.328197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.328134    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 19 04:15:21.330350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.330330    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 19 04:15:21.330568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.330553    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 19 04:15:21.331020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.330999    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 19 04:15:21.331020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.331084    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zlnfw\""
Sep 19 04:15:21.348613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.348587    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75877b7d76-7lp2n"]
Sep 19 04:15:21.452518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452486    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452567    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452672    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-grpc-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452696    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452939 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63acd33e-c569-48bd-850e-781306631818-metrics-client-ca\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.452939 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.452817    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqnmg\" (UniqueName: \"kubernetes.io/projected/63acd33e-c569-48bd-850e-781306631818-kube-api-access-dqnmg\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.553778 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.553948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553789    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.553948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-grpc-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.553948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553865    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.553948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553931    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63acd33e-c569-48bd-850e-781306631818-metrics-client-ca\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.554183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.553950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqnmg\" (UniqueName: \"kubernetes.io/projected/63acd33e-c569-48bd-850e-781306631818-kube-api-access-dqnmg\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.554183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.554006    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.554183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.554035    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.554929 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.554899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63acd33e-c569-48bd-850e-781306631818-metrics-client-ca\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.556986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.556963    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-grpc-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.557403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.557379    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.557507 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.557408    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.557723 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.557702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.557861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.557839    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-tls\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.558419 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.558399    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/63acd33e-c569-48bd-850e-781306631818-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.563875 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.563856    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqnmg\" (UniqueName: \"kubernetes.io/projected/63acd33e-c569-48bd-850e-781306631818-kube-api-access-dqnmg\") pod \"thanos-querier-75877b7d76-7lp2n\" (UID: \"63acd33e-c569-48bd-850e-781306631818\") " pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.635862 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.635779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:21.739535 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.739496    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"]
Sep 19 04:15:21.742856 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.742833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:21.745266 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.745238    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 19 04:15:21.745398 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.745334    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-tcbm9\""
Sep 19 04:15:21.756494 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.756468    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"]
Sep 19 04:15:21.856579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.856546    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skptw\" (UniqueName: \"kubernetes.io/projected/cbe34b2b-5afc-4d89-8417-59d99913db2e-kube-api-access-skptw\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:21.856579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.856624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:21.957253 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.957228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skptw\" (UniqueName: \"kubernetes.io/projected/cbe34b2b-5afc-4d89-8417-59d99913db2e-kube-api-access-skptw\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:21.957391 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.957306    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:21.957465 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:21.957445    2584 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 19 04:15:21.957540 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:21.957530    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert podName:cbe34b2b-5afc-4d89-8417-59d99913db2e nodeName:}" failed. No retries permitted until 2026-09-19 04:15:22.45751031 +0000 UTC m=+110.991491739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert") pod "monitoring-plugin-5984459ff8-vh7wj" (UID: "cbe34b2b-5afc-4d89-8417-59d99913db2e") : secret "monitoring-plugin-cert" not found
Sep 19 04:15:21.972206 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:21.972174    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skptw\" (UniqueName: \"kubernetes.io/projected/cbe34b2b-5afc-4d89-8417-59d99913db2e-kube-api-access-skptw\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:22.096066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.096029    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-75877b7d76-7lp2n"]
Sep 19 04:15:22.102258 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:22.102226    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63acd33e_c569_48bd_850e_781306631818.slice/crio-ab558ae9d54f5b1ddd513764389b5cfd271ac9ddd2fc6b5d58162f344a609486 WatchSource:0}: Error finding container ab558ae9d54f5b1ddd513764389b5cfd271ac9ddd2fc6b5d58162f344a609486: Status 404 returned error can't find the container with id ab558ae9d54f5b1ddd513764389b5cfd271ac9ddd2fc6b5d58162f344a609486
Sep 19 04:15:22.239679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.239646    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6656fb7dd-kg22k"]
Sep 19 04:15:22.242803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.242787    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.247166 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.247130    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 19 04:15:22.247479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.247463    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-xc9fh\""
Sep 19 04:15:22.247820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.247806    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 19 04:15:22.248086 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.248065    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-fes25i3a44sd6\""
Sep 19 04:15:22.248196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.248120    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 19 04:15:22.248196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.248146    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 19 04:15:22.266106 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.266088    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6656fb7dd-kg22k"]
Sep 19 04:15:22.360990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.360958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-client-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.360990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.360986    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw7kg\" (UniqueName: \"kubernetes.io/projected/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-kube-api-access-cw7kg\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.361151 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.361004    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-tls\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.361151 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.361030    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-metrics-server-audit-profiles\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.361151 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.361086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-audit-log\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.361256 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.361174    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-client-certs\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.361256 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.361208    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462401    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:22.462483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462436    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-client-certs\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462465    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462517    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-client-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462539    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw7kg\" (UniqueName: \"kubernetes.io/projected/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-kube-api-access-cw7kg\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-tls\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-metrics-server-audit-profiles\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.462712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.462639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-audit-log\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.463033 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.463012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-audit-log\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.463331 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.463310    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.463553 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.463533    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-metrics-server-audit-profiles\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.465238 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.465209    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-client-ca-bundle\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.465543 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.465521    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cbe34b2b-5afc-4d89-8417-59d99913db2e-monitoring-plugin-cert\") pod \"monitoring-plugin-5984459ff8-vh7wj\" (UID: \"cbe34b2b-5afc-4d89-8417-59d99913db2e\") " pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:22.465616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.465525    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-tls\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.465703 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.465686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-secret-metrics-server-client-certs\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.478202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.478183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw7kg\" (UniqueName: \"kubernetes.io/projected/e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81-kube-api-access-cw7kg\") pod \"metrics-server-6656fb7dd-kg22k\" (UID: \"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81\") " pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.551973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.551946    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:22.584338 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.584304    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"}
Sep 19 04:15:22.584500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.584383    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"}
Sep 19 04:15:22.584500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.584424    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"}
Sep 19 04:15:22.584500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.584451    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"}
Sep 19 04:15:22.584500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.584486    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"}
Sep 19 04:15:22.585364 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.585344    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"ab558ae9d54f5b1ddd513764389b5cfd271ac9ddd2fc6b5d58162f344a609486"}
Sep 19 04:15:22.654171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.654140    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:22.821820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.821781    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76fc478fff-n8pw8"]
Sep 19 04:15:22.825518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.825496    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.830675 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.829980    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 19 04:15:22.830675 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.830309    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 19 04:15:22.830675 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.830544    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 19 04:15:22.832018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.831320    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 19 04:15:22.832018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.831536    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 19 04:15:22.832018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.831811    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-vfmsh\""
Sep 19 04:15:22.848812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.848786    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 19 04:15:22.854980 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.854957    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6656fb7dd-kg22k"]
Sep 19 04:15:22.856973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.856951    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76fc478fff-n8pw8"]
Sep 19 04:15:22.948418 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.948388    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"]
Sep 19 04:15:22.967545 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-federate-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967751 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-serving-certs-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967826 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967795    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967845    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-metrics-client-ca\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.967909 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:22.967874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfcx\" (UniqueName: \"kubernetes.io/projected/889131ec-82aa-48bd-96d0-9174bfc4a9e9-kube-api-access-ctfcx\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:22.993582 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:22.993551    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7dfdc0f_25c7_4b91_8a1c_fdcd02dded81.slice/crio-5a6e8e59644db692cd4f2ae3eba6ab7bac240c756c12b76d7b70daae033ab7a2 WatchSource:0}: Error finding container 5a6e8e59644db692cd4f2ae3eba6ab7bac240c756c12b76d7b70daae033ab7a2: Status 404 returned error can't find the container with id 5a6e8e59644db692cd4f2ae3eba6ab7bac240c756c12b76d7b70daae033ab7a2
Sep 19 04:15:22.994499 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:22.994476    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbe34b2b_5afc_4d89_8417_59d99913db2e.slice/crio-33874cb0c7fba412c0a0aa1c8c3645b611ba597bac1ad7b26a0b1317b9a62521 WatchSource:0}: Error finding container 33874cb0c7fba412c0a0aa1c8c3645b611ba597bac1ad7b26a0b1317b9a62521: Status 404 returned error can't find the container with id 33874cb0c7fba412c0a0aa1c8c3645b611ba597bac1ad7b26a0b1317b9a62521
Sep 19 04:15:23.069250 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069223    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-serving-certs-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069270    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069359    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-metrics-client-ca\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069503 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069403    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfcx\" (UniqueName: \"kubernetes.io/projected/889131ec-82aa-48bd-96d0-9174bfc4a9e9-kube-api-access-ctfcx\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069503 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069499    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-federate-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.069613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.069596    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.070199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.070064    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-serving-certs-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.070199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.070107    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-metrics-client-ca\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.070199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.070191    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.072754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.072695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.072900 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.072882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.073057 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.073038    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-federate-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.073154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.073138    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/889131ec-82aa-48bd-96d0-9174bfc4a9e9-telemeter-client-tls\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.085708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.085685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfcx\" (UniqueName: \"kubernetes.io/projected/889131ec-82aa-48bd-96d0-9174bfc4a9e9-kube-api-access-ctfcx\") pod \"telemeter-client-76fc478fff-n8pw8\" (UID: \"889131ec-82aa-48bd-96d0-9174bfc4a9e9\") " pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.138003 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.137961    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8"
Sep 19 04:15:23.420073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.419982    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76fc478fff-n8pw8"]
Sep 19 04:15:23.424484 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:23.424447    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod889131ec_82aa_48bd_96d0_9174bfc4a9e9.slice/crio-604cf8b4e66954eb5a8fdc6995b2950de9416bc7916073ec5dd3cb09b36715c7 WatchSource:0}: Error finding container 604cf8b4e66954eb5a8fdc6995b2950de9416bc7916073ec5dd3cb09b36715c7: Status 404 returned error can't find the container with id 604cf8b4e66954eb5a8fdc6995b2950de9416bc7916073ec5dd3cb09b36715c7
Sep 19 04:15:23.598971 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.598930    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerStarted","Data":"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"}
Sep 19 04:15:23.601934 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.601886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj" event={"ID":"cbe34b2b-5afc-4d89-8417-59d99913db2e","Type":"ContainerStarted","Data":"33874cb0c7fba412c0a0aa1c8c3645b611ba597bac1ad7b26a0b1317b9a62521"}
Sep 19 04:15:23.609088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.609047    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8" event={"ID":"889131ec-82aa-48bd-96d0-9174bfc4a9e9","Type":"ContainerStarted","Data":"604cf8b4e66954eb5a8fdc6995b2950de9416bc7916073ec5dd3cb09b36715c7"}
Sep 19 04:15:23.611178 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:23.611149    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k" event={"ID":"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81","Type":"ContainerStarted","Data":"5a6e8e59644db692cd4f2ae3eba6ab7bac240c756c12b76d7b70daae033ab7a2"}
Sep 19 04:15:24.546501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:24.546471    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lx2tb"
Sep 19 04:15:24.571152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:24.571087    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.364503614 podStartE2EDuration="6.57106274s" totalImagesPullingTime="3.192739576s" totalInitContainerRuntime="13.81955ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:23.672215256 +0000 UTC m=+112.206196694" watchObservedRunningTime="2026-09-19 04:15:24.57106274 +0000 UTC m=+113.105044181"
Sep 19 04:15:25.625292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.625251    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"7fabcb1e985bfcf2f1bfed20ae77a0c5b8a4d1f0d1a70cf8313670964d51cec7"}
Sep 19 04:15:25.627127 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.627085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj" event={"ID":"cbe34b2b-5afc-4d89-8417-59d99913db2e","Type":"ContainerStarted","Data":"05ca8cf6448536703f07acd8d4321d3b06a70972b6ec756301bd70d2592ae159"}
Sep 19 04:15:25.627342 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.627269    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:25.629179 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.629149    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k" event={"ID":"e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81","Type":"ContainerStarted","Data":"00fea0d4c23c24edbdc6096eb584d832afd60799cb326b4329c822a5852edd08"}
Sep 19 04:15:25.633160 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.633137    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj"
Sep 19 04:15:25.709334 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.709151    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5984459ff8-vh7wj" podStartSLOduration=2.480829628 podStartE2EDuration="4.709133588s" totalImagesPullingTime="2.22830396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:25.673827595 +0000 UTC m=+114.207809045" watchObservedRunningTime="2026-09-19 04:15:25.709133588 +0000 UTC m=+114.243115025"
Sep 19 04:15:25.747399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:25.747343    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k" podStartSLOduration=1.514899885 podStartE2EDuration="3.74732306s" totalImagesPullingTime="2.232423175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:25.74607834 +0000 UTC m=+114.280059779" watchObservedRunningTime="2026-09-19 04:15:25.74732306 +0000 UTC m=+114.281304497"
Sep 19 04:15:26.637764 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637724    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"4bc32f2aadb3cb1ba8bb695f8b7e922231e98d980c1d0f033078ef012fa87387"}
Sep 19 04:15:26.638189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"0049839c8e2e2b14d6cc0a95fb64fcc6ab0d281f17b2e9ca0734d13a6b757f10"}
Sep 19 04:15:26.638189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637848    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"c0cef844a6a0b9beac226213c4bfbb73a4b278b9e541ac2382270f889b53de57"}
Sep 19 04:15:26.638189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637876    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"48fab85fef40031213743ff68f8ea131040cf9f4ae128183ed6dd0d6a2a01139"}
Sep 19 04:15:26.638189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637918    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:26.638189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.637954    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" event={"ID":"63acd33e-c569-48bd-850e-781306631818","Type":"ContainerStarted","Data":"4057834c917eb07de827b367e24745c24434d075e2f2c249cb8a166a60550400"}
Sep 19 04:15:26.639851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.639825    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8" event={"ID":"889131ec-82aa-48bd-96d0-9174bfc4a9e9","Type":"ContainerStarted","Data":"de9a214e919dbfa5396dbdf8df467075fcdefbe1a9e1feae0b4eafec0438f3e7"}
Sep 19 04:15:26.639946 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.639870    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8" event={"ID":"889131ec-82aa-48bd-96d0-9174bfc4a9e9","Type":"ContainerStarted","Data":"ce9a5514948f2787dedff403b4b837c384d22ec5feaa7e05be60310d68c3261d"}
Sep 19 04:15:26.639946 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.639892    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8" event={"ID":"889131ec-82aa-48bd-96d0-9174bfc4a9e9","Type":"ContainerStarted","Data":"f06dc4604a0a8e692faf8ef1c5a3c42401dafc432a6d7a7063fe667235673657"}
Sep 19 04:15:26.672520 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.672470    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n" podStartSLOduration=2.551822776 podStartE2EDuration="5.672452855s" totalImagesPullingTime="3.120630079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:26.67044745 +0000 UTC m=+115.204428888" watchObservedRunningTime="2026-09-19 04:15:26.672452855 +0000 UTC m=+115.206434293"
Sep 19 04:15:26.706096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:26.706043    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76fc478fff-n8pw8" podStartSLOduration=2.284280257 podStartE2EDuration="4.706026708s" totalImagesPullingTime="2.421746451s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:26.705268538 +0000 UTC m=+115.239250000" watchObservedRunningTime="2026-09-19 04:15:26.706026708 +0000 UTC m=+115.240008140"
Sep 19 04:15:29.099701 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:29.099666    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:15:29.104027 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:29.103990    2584 patch_prober.go:28] interesting pod/image-registry-866988c6-5vsk2 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 19 04:15:29.104149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:29.104042    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-866988c6-5vsk2" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:15:32.650692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:32.650662    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-75877b7d76-7lp2n"
Sep 19 04:15:32.961222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:32.961152    2584 scope.go:117] "RemoveContainer" containerID="9b59c30879c36016174ccb89cf33031bb178c008c6199a07bf96804955a11751"
Sep 19 04:15:33.668737 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:33.668706    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:15:33.669210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:33.668773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" event={"ID":"8e563010-443f-431f-95a4-e94696381c84","Type":"ContainerStarted","Data":"eeae39f70660a9954c187eff54c113164ff36f7250dd5e8a4c4ffc0848cf250d"}
Sep 19 04:15:33.669684 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:33.669377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:15:33.690462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:33.690411    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr" podStartSLOduration=56.71419415 podStartE2EDuration="58.690395313s" totalImagesPullingTime="1.976201163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:14:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:33.690323968 +0000 UTC m=+122.224305407" watchObservedRunningTime="2026-09-19 04:15:33.690395313 +0000 UTC m=+122.224376752"
Sep 19 04:15:33.957494 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:33.957408    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-fd4bb46c-zj8pr"
Sep 19 04:15:39.104767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:39.104736    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:41.745958 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:41.745918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:15:41.748506 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:41.748486    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b5262ca8-5acb-4c3b-8b47-722259900eab-metrics-certs\") pod \"network-metrics-daemon-5tz5c\" (UID: \"b5262ca8-5acb-4c3b-8b47-722259900eab\") " pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:15:41.782831 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:41.782803    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zg2ns\""
Sep 19 04:15:41.790326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:41.790309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5tz5c"
Sep 19 04:15:42.091519 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:42.091475    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5tz5c"]
Sep 19 04:15:42.094593 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:15:42.094564    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5262ca8_5acb_4c3b_8b47_722259900eab.slice/crio-59fed7861b4dc52b64645224c0a4acb7dd311c15066d46fd6f89a58c488d9fa4 WatchSource:0}: Error finding container 59fed7861b4dc52b64645224c0a4acb7dd311c15066d46fd6f89a58c488d9fa4: Status 404 returned error can't find the container with id 59fed7861b4dc52b64645224c0a4acb7dd311c15066d46fd6f89a58c488d9fa4
Sep 19 04:15:42.554148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:42.553561    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:42.554148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:42.553628    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:15:42.707469 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:42.707437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5tz5c" event={"ID":"b5262ca8-5acb-4c3b-8b47-722259900eab","Type":"ContainerStarted","Data":"59fed7861b4dc52b64645224c0a4acb7dd311c15066d46fd6f89a58c488d9fa4"}
Sep 19 04:15:43.712996 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:43.712964    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5tz5c" event={"ID":"b5262ca8-5acb-4c3b-8b47-722259900eab","Type":"ContainerStarted","Data":"fbd8bfa28f28861284e526658a788871e9c7e1cbb2b7cc14ef695ff9d501d0c6"}
Sep 19 04:15:43.713380 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:43.713019    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5tz5c" event={"ID":"b5262ca8-5acb-4c3b-8b47-722259900eab","Type":"ContainerStarted","Data":"053038ff67cc294e7e83eb62252eb238022d57c8cbd2ba8d76adf26bc70d45c7"}
Sep 19 04:15:43.737662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:43.737614    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5tz5c" podStartSLOduration=130.75827249 podStartE2EDuration="2m11.737599467s" totalImagesPullingTime="979.326977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:13:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:15:43.736361542 +0000 UTC m=+132.270342981" watchObservedRunningTime="2026-09-19 04:15:43.737599467 +0000 UTC m=+132.271580904"
Sep 19 04:15:54.119340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.119257    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-866988c6-5vsk2" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerName="registry" containerID="cri-o://660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18" gracePeriod=30
Sep 19 04:15:54.385634 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.385574    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:54.453558 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453533    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6vsm\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453565    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453596    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453732    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453825    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453862    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.453908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.453890    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca\") pod \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\" (UID: \"9724ae83-2f16-43dd-ac2d-dc5c1299094b\") "
Sep 19 04:15:54.454097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.454068    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:15:54.454225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.454172    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-certificates\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.454677 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.454650    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:15:54.456349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.456302    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:15:54.456457 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.456372    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm" (OuterVolumeSpecName: "kube-api-access-p6vsm") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "kube-api-access-p6vsm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:15:54.456575 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.456550    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:15:54.456735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.456719    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:15:54.456795 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.456731    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:15:54.462493 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.462468    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "9724ae83-2f16-43dd-ac2d-dc5c1299094b" (UID: "9724ae83-2f16-43dd-ac2d-dc5c1299094b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:15:54.554490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554463    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6vsm\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-kube-api-access-p6vsm\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554486    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-installation-pull-secrets\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554496    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/9724ae83-2f16-43dd-ac2d-dc5c1299094b-image-registry-private-configuration\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554505    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/9724ae83-2f16-43dd-ac2d-dc5c1299094b-ca-trust-extracted\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554514    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-bound-sa-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554523    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/9724ae83-2f16-43dd-ac2d-dc5c1299094b-registry-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.554631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.554530    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/9724ae83-2f16-43dd-ac2d-dc5c1299094b-trusted-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:15:54.756010 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.755932    2584 generic.go:356] "Generic (PLEG): container finished" podID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerID="660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18" exitCode=0
Sep 19 04:15:54.756010 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.755976    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-866988c6-5vsk2"
Sep 19 04:15:54.756177 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.755977    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866988c6-5vsk2" event={"ID":"9724ae83-2f16-43dd-ac2d-dc5c1299094b","Type":"ContainerDied","Data":"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"}
Sep 19 04:15:54.756177 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.756103    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-866988c6-5vsk2" event={"ID":"9724ae83-2f16-43dd-ac2d-dc5c1299094b","Type":"ContainerDied","Data":"5fed48b8913675338997191d7c4acf8d5c3839af6e4ca41e2329c776578b5431"}
Sep 19 04:15:54.756177 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.756125    2584 scope.go:117] "RemoveContainer" containerID="660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"
Sep 19 04:15:54.765214 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.765195    2584 scope.go:117] "RemoveContainer" containerID="660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"
Sep 19 04:15:54.765513 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:15:54.765491    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18\": container with ID starting with 660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18 not found: ID does not exist" containerID="660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"
Sep 19 04:15:54.765575 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.765522    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18"} err="failed to get container status \"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18\": rpc error: code = NotFound desc = could not find container \"660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18\": container with ID starting with 660a9e02e4ce83ddaf65c6856c59957ae4f9eee0248d4f6c8c2d51406d13dd18 not found: ID does not exist"
Sep 19 04:15:54.796696 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.796665    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:15:54.799172 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:54.799150    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-866988c6-5vsk2"]
Sep 19 04:15:55.030323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.030201    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/init-config-reloader/0.log"
Sep 19 04:15:55.040653 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.040629    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/alertmanager/0.log"
Sep 19 04:15:55.048502 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.048482    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/config-reloader/0.log"
Sep 19 04:15:55.239987 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.239963    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/kube-rbac-proxy-web/0.log"
Sep 19 04:15:55.435241 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.435217    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/kube-rbac-proxy/0.log"
Sep 19 04:15:55.635494 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.635462    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/kube-rbac-proxy-metric/0.log"
Sep 19 04:15:55.834308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.834260    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6d94beb8-e82b-4873-ba68-1cd4fbd616a4/prom-label-proxy/0.log"
Sep 19 04:15:55.965722 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:55.965694    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" path="/var/lib/kubelet/pods/9724ae83-2f16-43dd-ac2d-dc5c1299094b/volumes"
Sep 19 04:15:56.834775 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:56.834722    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6656fb7dd-kg22k_e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81/metrics-server/0.log"
Sep 19 04:15:57.035411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:57.035384    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-vh7wj_cbe34b2b-5afc-4d89-8417-59d99913db2e/monitoring-plugin/0.log"
Sep 19 04:15:58.434524 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:58.434495    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/init-textfile/0.log"
Sep 19 04:15:58.635295 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:58.635261    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/node-exporter/0.log"
Sep 19 04:15:58.833940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:15:58.833912    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/kube-rbac-proxy/0.log"
Sep 19 04:16:01.037655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:01.037619    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4z2d2_9a79bfb2-4ab1-4332-8230-e725f7430454/prometheus-operator/0.log"
Sep 19 04:16:01.240593 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:01.240523    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4z2d2_9a79bfb2-4ab1-4332-8230-e725f7430454/kube-rbac-proxy/0.log"
Sep 19 04:16:01.635816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:01.635779    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/telemeter-client/0.log"
Sep 19 04:16:01.835247 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:01.835222    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/reload/0.log"
Sep 19 04:16:02.035187 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.035115    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/kube-rbac-proxy/0.log"
Sep 19 04:16:02.238793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.238766    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/thanos-query/0.log"
Sep 19 04:16:02.436370 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.436309    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-web/0.log"
Sep 19 04:16:02.557562 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.557528    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:16:02.561226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.561198    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6656fb7dd-kg22k"
Sep 19 04:16:02.645870 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.645842    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy/0.log"
Sep 19 04:16:02.842146 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:02.842111    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/prom-label-proxy/0.log"
Sep 19 04:16:03.034692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:03.034662    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-rules/0.log"
Sep 19 04:16:03.239114 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:03.239038    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-metrics/0.log"
Sep 19 04:16:03.433930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:03.433898    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-5k9xj_d3b8c698-7c35-4cef-b894-7c7e9529e287/networking-console-plugin/0.log"
Sep 19 04:16:03.637758 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:03.637724    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:16:03.836438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:03.836407    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/3.log"
Sep 19 04:16:38.446205 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446170    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446448    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="alertmanager" containerID="cri-o://30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7" gracePeriod=120
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446503    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-metric" containerID="cri-o://63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf" gracePeriod=120
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446536    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="config-reloader" containerID="cri-o://8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b" gracePeriod=120
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446564    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy" containerID="cri-o://bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5" gracePeriod=120
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446576    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="prom-label-proxy" containerID="cri-o://1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c" gracePeriod=120
Sep 19 04:16:38.446712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.446508    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-web" containerID="cri-o://276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b" gracePeriod=120
Sep 19 04:16:38.935717 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935686    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c" exitCode=0
Sep 19 04:16:38.935717 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935709    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5" exitCode=0
Sep 19 04:16:38.935717 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935717    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b" exitCode=0
Sep 19 04:16:38.935717 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935722    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7" exitCode=0
Sep 19 04:16:38.936028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935761    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"}
Sep 19 04:16:38.936028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935838    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"}
Sep 19 04:16:38.936028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935878    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"}
Sep 19 04:16:38.936028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:38.935913    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"}
Sep 19 04:16:39.795185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.795152    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:39.827833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827806    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.827966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827839    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.827966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827860    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.827966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827885    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.827966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827909    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.827966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.827988    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828034    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828070    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828094    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828107    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828133    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll75k\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828161    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828224    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config\") pod \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\" (UID: \"6d94beb8-e82b-4873-ba68-1cd4fbd616a4\") "
Sep 19 04:16:39.828615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.828489    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-main-db\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.830262 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.830233    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:39.831139 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.831081    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:16:39.831239 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.831149    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.831324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.831246    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:16:39.831324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.831292    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.831441 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.831323    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out" (OuterVolumeSpecName: "config-out") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:16:39.832455 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.832427    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume" (OuterVolumeSpecName: "config-volume") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.832721 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.832681    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.833107 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.833077    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.833442 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.833421    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k" (OuterVolumeSpecName: "kube-api-access-ll75k") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "kube-api-access-ll75k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:16:39.837755 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.837723    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.845428 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.845408    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config" (OuterVolumeSpecName: "web-config") pod "6d94beb8-e82b-4873-ba68-1cd4fbd616a4" (UID: "6d94beb8-e82b-4873-ba68-1cd4fbd616a4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:16:39.928823 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928793    2584 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.928823 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928820    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.928823 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928828    2584 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-config-out\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928837    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928845    2584 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-tls-assets\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928853    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-metrics-client-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928861    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928870    2584 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-secret-alertmanager-main-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928878    2584 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-cluster-tls-config\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928886    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll75k\" (UniqueName: \"kubernetes.io/projected/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-kube-api-access-ll75k\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928894    2584 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.929020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.928903    2584 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6d94beb8-e82b-4873-ba68-1cd4fbd616a4-web-config\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:16:39.942843 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942817    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf" exitCode=0
Sep 19 04:16:39.942843 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942840    2584 generic.go:356] "Generic (PLEG): container finished" podID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerID="276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b" exitCode=0
Sep 19 04:16:39.942990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942849    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"}
Sep 19 04:16:39.942990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942887    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:39.942990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942916    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"}
Sep 19 04:16:39.942990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942943    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6d94beb8-e82b-4873-ba68-1cd4fbd616a4","Type":"ContainerDied","Data":"734b06ef4913ea15c1aa5ce3380677d51b990ecfe4b975e7a6c258e84e397107"}
Sep 19 04:16:39.942990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.942974    2584 scope.go:117] "RemoveContainer" containerID="1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"
Sep 19 04:16:39.953476 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.952187    2584 scope.go:117] "RemoveContainer" containerID="63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"
Sep 19 04:16:39.959997 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.959977    2584 scope.go:117] "RemoveContainer" containerID="bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"
Sep 19 04:16:39.967064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.967041    2584 scope.go:117] "RemoveContainer" containerID="276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"
Sep 19 04:16:39.973558 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.973541    2584 scope.go:117] "RemoveContainer" containerID="8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"
Sep 19 04:16:39.980145 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.980129    2584 scope.go:117] "RemoveContainer" containerID="30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"
Sep 19 04:16:39.987072 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.987057    2584 scope.go:117] "RemoveContainer" containerID="b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"
Sep 19 04:16:39.987373 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.987355    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:39.993584 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.993567    2584 scope.go:117] "RemoveContainer" containerID="1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"
Sep 19 04:16:39.993846 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.993827    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c\": container with ID starting with 1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c not found: ID does not exist" containerID="1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"
Sep 19 04:16:39.993922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.993857    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"} err="failed to get container status \"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c\": rpc error: code = NotFound desc = could not find container \"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c\": container with ID starting with 1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c not found: ID does not exist"
Sep 19 04:16:39.993922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.993878    2584 scope.go:117] "RemoveContainer" containerID="63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"
Sep 19 04:16:39.994144 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.994122    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf\": container with ID starting with 63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf not found: ID does not exist" containerID="63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"
Sep 19 04:16:39.994184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994151    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"} err="failed to get container status \"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf\": rpc error: code = NotFound desc = could not find container \"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf\": container with ID starting with 63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf not found: ID does not exist"
Sep 19 04:16:39.994184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994166    2584 scope.go:117] "RemoveContainer" containerID="bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"
Sep 19 04:16:39.994423 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.994406    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5\": container with ID starting with bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5 not found: ID does not exist" containerID="bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"
Sep 19 04:16:39.994470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994428    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"} err="failed to get container status \"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5\": rpc error: code = NotFound desc = could not find container \"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5\": container with ID starting with bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5 not found: ID does not exist"
Sep 19 04:16:39.994470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994442    2584 scope.go:117] "RemoveContainer" containerID="276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"
Sep 19 04:16:39.994682 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.994665    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b\": container with ID starting with 276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b not found: ID does not exist" containerID="276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"
Sep 19 04:16:39.994718 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994686    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"} err="failed to get container status \"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b\": rpc error: code = NotFound desc = could not find container \"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b\": container with ID starting with 276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b not found: ID does not exist"
Sep 19 04:16:39.994718 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994698    2584 scope.go:117] "RemoveContainer" containerID="8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"
Sep 19 04:16:39.994886 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.994874    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b\": container with ID starting with 8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b not found: ID does not exist" containerID="8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"
Sep 19 04:16:39.994936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994887    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"} err="failed to get container status \"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b\": rpc error: code = NotFound desc = could not find container \"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b\": container with ID starting with 8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b not found: ID does not exist"
Sep 19 04:16:39.994936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.994898    2584 scope.go:117] "RemoveContainer" containerID="30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"
Sep 19 04:16:39.995096 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.995083    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7\": container with ID starting with 30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7 not found: ID does not exist" containerID="30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"
Sep 19 04:16:39.995138 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995098    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"} err="failed to get container status \"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7\": rpc error: code = NotFound desc = could not find container \"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7\": container with ID starting with 30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7 not found: ID does not exist"
Sep 19 04:16:39.995138 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995108    2584 scope.go:117] "RemoveContainer" containerID="b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"
Sep 19 04:16:39.995310 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:16:39.995296    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a\": container with ID starting with b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a not found: ID does not exist" containerID="b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"
Sep 19 04:16:39.995352 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995311    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"} err="failed to get container status \"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a\": rpc error: code = NotFound desc = could not find container \"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a\": container with ID starting with b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a not found: ID does not exist"
Sep 19 04:16:39.995352 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995321    2584 scope.go:117] "RemoveContainer" containerID="1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"
Sep 19 04:16:39.995501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995486    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c"} err="failed to get container status \"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c\": rpc error: code = NotFound desc = could not find container \"1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c\": container with ID starting with 1beb42045e479bb5ff51c4fc49bece149f3fcf27fbed1ac417f4ada1a9947b7c not found: ID does not exist"
Sep 19 04:16:39.995501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995499    2584 scope.go:117] "RemoveContainer" containerID="63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"
Sep 19 04:16:39.995668 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995653    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf"} err="failed to get container status \"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf\": rpc error: code = NotFound desc = could not find container \"63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf\": container with ID starting with 63116d05b4930ec7a8e2093b854f435ad281415a38b2a53c963a9623685f75bf not found: ID does not exist"
Sep 19 04:16:39.995668 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995666    2584 scope.go:117] "RemoveContainer" containerID="bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"
Sep 19 04:16:39.995868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995850    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5"} err="failed to get container status \"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5\": rpc error: code = NotFound desc = could not find container \"bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5\": container with ID starting with bdec84757e9e09737f508420ec6bd0f7a4499170b22838732fd8a8c1d7a02fe5 not found: ID does not exist"
Sep 19 04:16:39.995908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.995869    2584 scope.go:117] "RemoveContainer" containerID="276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"
Sep 19 04:16:39.996100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996084    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b"} err="failed to get container status \"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b\": rpc error: code = NotFound desc = could not find container \"276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b\": container with ID starting with 276b7ec009e3cbfacfeed917a96e481a2a7ae490e03ebe84d779e7e0303a1e7b not found: ID does not exist"
Sep 19 04:16:39.996141 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996100    2584 scope.go:117] "RemoveContainer" containerID="8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"
Sep 19 04:16:39.996395 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996372    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b"} err="failed to get container status \"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b\": rpc error: code = NotFound desc = could not find container \"8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b\": container with ID starting with 8a632ab0194ea9a25e899fb50bb6f57081a30fd3c0adbe65f36af7c3dc26186b not found: ID does not exist"
Sep 19 04:16:39.996442 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996397    2584 scope.go:117] "RemoveContainer" containerID="30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"
Sep 19 04:16:39.996623 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996609    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7"} err="failed to get container status \"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7\": rpc error: code = NotFound desc = could not find container \"30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7\": container with ID starting with 30b6e74aa7dfbe208ed1b3e33790ba141b3462e3e8e58b1eee4697a51dd980d7 not found: ID does not exist"
Sep 19 04:16:39.996662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996624    2584 scope.go:117] "RemoveContainer" containerID="b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"
Sep 19 04:16:39.996842 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:39.996822    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a"} err="failed to get container status \"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a\": rpc error: code = NotFound desc = could not find container \"b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a\": container with ID starting with b2c88583d5a893bfb4658563e508f20db42dbe809857220af1bf9f2d7dd5450a not found: ID does not exist"
Sep 19 04:16:40.004571 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.004550    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:40.075812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.075784    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:40.076054 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076043    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerName="registry"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076055    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerName="registry"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076063    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="alertmanager"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076068    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="alertmanager"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076077    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="config-reloader"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076083    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="config-reloader"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076088    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-web"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076093    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-web"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076099    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy"
Sep 19 04:16:40.076100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076104    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076112    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="init-config-reloader"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076117    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="init-config-reloader"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076122    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="prom-label-proxy"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076127    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="prom-label-proxy"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076142    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-metric"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076148    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-metric"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076193    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="config-reloader"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076201    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="prom-label-proxy"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076208    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="alertmanager"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076214    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9724ae83-2f16-43dd-ac2d-dc5c1299094b" containerName="registry"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076220    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076225    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-web"
Sep 19 04:16:40.076411 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.076230    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" containerName="kube-rbac-proxy-metric"
Sep 19 04:16:40.081070 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.081053    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.086736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.086717    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Sep 19 04:16:40.086851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.086719    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Sep 19 04:16:40.086851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.086718    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Sep 19 04:16:40.087190 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.087168    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Sep 19 04:16:40.087477 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.087458    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Sep 19 04:16:40.087580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.087506    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Sep 19 04:16:40.087799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.087782    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vlxvw\""
Sep 19 04:16:40.088478 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.088462    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Sep 19 04:16:40.089041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.089023    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Sep 19 04:16:40.097243 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.097225    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Sep 19 04:16:40.128180 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.128149    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:40.130251 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130264    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130533 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130421    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kxjf\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-kube-api-access-6kxjf\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130533 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130448    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130533 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-web-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130533 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130521    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130552    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-config-volume\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130602    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-config-out\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.130735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.130670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.231814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.231778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-config-volume\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.231814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.231810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-config-out\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.231828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232162 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232138    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232242 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232215    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232305    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kxjf\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-kube-api-access-6kxjf\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232404    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232427    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-web-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232651 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.232651 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.234244 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.232837    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.234244 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.233671    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.234244 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.234007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/018ae69a-33cf-4d9c-974a-b5ab20049090-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.234830 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.234800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/018ae69a-33cf-4d9c-974a-b5ab20049090-config-out\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.235159 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.235134    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.235331 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.235307    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.235447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.235397    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-config-volume\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.235519 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.235465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-tls-assets\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.235649 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.235629    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-web-config\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.236702 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.236682    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.236865 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.236848    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.236914 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.236876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/018ae69a-33cf-4d9c-974a-b5ab20049090-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.252074 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.252056    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kxjf\" (UniqueName: \"kubernetes.io/projected/018ae69a-33cf-4d9c-974a-b5ab20049090-kube-api-access-6kxjf\") pod \"alertmanager-main-0\" (UID: \"018ae69a-33cf-4d9c-974a-b5ab20049090\") " pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.393152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.393079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Sep 19 04:16:40.707865 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.707837    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Sep 19 04:16:40.709840 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:16:40.709807    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod018ae69a_33cf_4d9c_974a_b5ab20049090.slice/crio-68870f5389a1d94558154a525a989103a6979630d53e15de98540cca62fdc682 WatchSource:0}: Error finding container 68870f5389a1d94558154a525a989103a6979630d53e15de98540cca62fdc682: Status 404 returned error can't find the container with id 68870f5389a1d94558154a525a989103a6979630d53e15de98540cca62fdc682
Sep 19 04:16:40.948708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.948679    2584 generic.go:356] "Generic (PLEG): container finished" podID="018ae69a-33cf-4d9c-974a-b5ab20049090" containerID="f7c8f2d3b4c283685e5bf8cea2b90612f25a613b2a7b36b2c52a71d1e1ba1146" exitCode=0
Sep 19 04:16:40.949049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.948745    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerDied","Data":"f7c8f2d3b4c283685e5bf8cea2b90612f25a613b2a7b36b2c52a71d1e1ba1146"}
Sep 19 04:16:40.949049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:40.948797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"68870f5389a1d94558154a525a989103a6979630d53e15de98540cca62fdc682"}
Sep 19 04:16:41.955111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955074    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"5a5aa58358eaef5a9146a72866ace5489aa4a89fc125065fb0419765446a2791"}
Sep 19 04:16:41.955528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"e1c32a9e73cd8c481ea390125bd2e602bf54527f212b8382a93e51f61f4d9479"}
Sep 19 04:16:41.955528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955232    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"934dce1d77d2155c4da2599d225251e6fa5065e1cb150e3d6c6970baa2ff79a2"}
Sep 19 04:16:41.955528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"49125bd5d258ead2775074541bd0a1c59255a66c1dd494dd20402e4a7b143e87"}
Sep 19 04:16:41.955528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955325    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"d8346d6eb903913ceca584d1087a8577ae1b0fd1745d1971eb1e71cd50bd4a92"}
Sep 19 04:16:41.955528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.955366    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"018ae69a-33cf-4d9c-974a-b5ab20049090","Type":"ContainerStarted","Data":"bab0eedc1d194edf4a7b9f24690817238dafbec9ae1d32e9070af28c5db60bbe"}
Sep 19 04:16:41.965730 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.965704    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d94beb8-e82b-4873-ba68-1cd4fbd616a4" path="/var/lib/kubelet/pods/6d94beb8-e82b-4873-ba68-1cd4fbd616a4/volumes"
Sep 19 04:16:41.991151 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:16:41.991097    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.972271074 podStartE2EDuration="1.991079141s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.808067ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:16:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:16:41.988621062 +0000 UTC m=+190.522602499" watchObservedRunningTime="2026-09-19 04:16:41.991079141 +0000 UTC m=+190.525060579"
Sep 19 04:17:54.844311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.844217    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"]
Sep 19 04:17:54.847615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.847598    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:54.851554 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.851532    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ldcjk\""
Sep 19 04:17:54.851655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.851555    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 19 04:17:54.852295 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.852250    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 19 04:17:54.866457 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.866435    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"]
Sep 19 04:17:54.920530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.920488    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:54.920689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.920544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vwmk\" (UniqueName: \"kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:54.920689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.920600    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:54.996796 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:54.996763    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"]
Sep 19 04:17:55.000064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.000043    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.011380 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.011358    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"]
Sep 19 04:17:55.021074 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021054    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqbgd\" (UniqueName: \"kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.021157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021096    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.021157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.021157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021139    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.021262 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.021262 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021207    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vwmk\" (UniqueName: \"kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.021488 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021465    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.021488 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.021481    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.036431 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.036404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vwmk\" (UniqueName: \"kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.121833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.121773    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.121833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.121804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.121973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.121874    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqbgd\" (UniqueName: \"kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.122187 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.122164    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.122227 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.122181    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.131864 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.131841    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqbgd\" (UniqueName: \"kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd\") pod \"978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") " pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.156404 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.156382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:17:55.215798 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.215764    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:17:55.220915 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.220887    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.224418 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.224397    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 19 04:17:55.224908 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.224856    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 19 04:17:55.225348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.225187    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 19 04:17:55.225348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.225214    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 19 04:17:55.225348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.225224    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 19 04:17:55.225348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.225235    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 19 04:17:55.225348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.225239    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g7695\""
Sep 19 04:17:55.236614 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.236589    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:17:55.308951 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.308913    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:17:55.323583 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323684 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323619    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323725 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323701    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqz4s\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323771 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323806 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323786    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323843 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323803    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.323843 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.323820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.424658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.424658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.424658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.424894 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.424894 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424858    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.425031 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424922    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqz4s\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.425031 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.424955    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.425328 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.425268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.427141 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.427120    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.427141 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.427139    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.427311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.427169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.427311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.427193    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.434408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.434067    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"]
Sep 19 04:17:55.434408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.434319    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqz4s\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.436915 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.436858    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-5b7l6\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.438621 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:17:55.438597    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3304300_278a_494f_ac29_056ad7d71f6e.slice/crio-2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836 WatchSource:0}: Error finding container 2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836: Status 404 returned error can't find the container with id 2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836
Sep 19 04:17:55.531267 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.531239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:55.582142 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.581904    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"]
Sep 19 04:17:55.807153 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:55.807113    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:17:55.809657 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:17:55.809632    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod941fb747_0d4e_4dd3_85ac_cad3ae03e287.slice/crio-ae75098e3c2c99b975c4a2cbcc49aa68bcf17c034bba8741b90cb0a1b30accf4 WatchSource:0}: Error finding container ae75098e3c2c99b975c4a2cbcc49aa68bcf17c034bba8741b90cb0a1b30accf4: Status 404 returned error can't find the container with id ae75098e3c2c99b975c4a2cbcc49aa68bcf17c034bba8741b90cb0a1b30accf4
Sep 19 04:17:56.247747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:56.247666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv" event={"ID":"325b85fd-ddc2-4df9-9336-6c6a4160e666","Type":"ContainerStarted","Data":"876fd0c76e772b6d4c71e45dc36acb634aee18f28f9d3abb39a1f2366cfcb7f6"}
Sep 19 04:17:56.249242 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:56.249211    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" event={"ID":"941fb747-0d4e-4dd3-85ac-cad3ae03e287","Type":"ContainerStarted","Data":"ae75098e3c2c99b975c4a2cbcc49aa68bcf17c034bba8741b90cb0a1b30accf4"}
Sep 19 04:17:56.250545 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:56.250518    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc" event={"ID":"c3304300-278a-494f-ac29-056ad7d71f6e","Type":"ContainerStarted","Data":"2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836"}
Sep 19 04:17:59.021186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:59.020979    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:17:59.021186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:59.021064    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:17:59.269824 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:59.269741    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" event={"ID":"941fb747-0d4e-4dd3-85ac-cad3ae03e287","Type":"ContainerStarted","Data":"45d34fc7a14c2c24576dcb83feeb0846e11a2f1c4414348b49715924a8d49975"}
Sep 19 04:17:59.270007 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:59.269829    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:17:59.294555 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:17:59.294478    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" podStartSLOduration=1.085450374 podStartE2EDuration="4.294462994s" totalImagesPullingTime="3.20901262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:17:59.293175894 +0000 UTC m=+267.827157332" watchObservedRunningTime="2026-09-19 04:17:59.294462994 +0000 UTC m=+267.828444432"
Sep 19 04:18:00.276622 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:00.276578    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-5b7l6 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 04:18:00.277029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:00.276641    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:18:02.290148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:02.290110    2584 generic.go:356] "Generic (PLEG): container finished" podID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerID="705604c84cc79bc99dd07bbaaa13a358852cf865029813ee4a6c0725abba841b" exitCode=0
Sep 19 04:18:02.290589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:02.290190    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv" event={"ID":"325b85fd-ddc2-4df9-9336-6c6a4160e666","Type":"ContainerDied","Data":"705604c84cc79bc99dd07bbaaa13a358852cf865029813ee4a6c0725abba841b"}
Sep 19 04:18:02.292038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:02.292011    2584 generic.go:356] "Generic (PLEG): container finished" podID="c3304300-278a-494f-ac29-056ad7d71f6e" containerID="e827a27878c4260a45cef927a69483bcc6691e02af5b2eab8f2d119106226384" exitCode=0
Sep 19 04:18:02.292129 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:02.292084    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc" event={"ID":"c3304300-278a-494f-ac29-056ad7d71f6e","Type":"ContainerDied","Data":"e827a27878c4260a45cef927a69483bcc6691e02af5b2eab8f2d119106226384"}
Sep 19 04:18:03.275920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:03.275887    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:18:03.299671 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:03.299590    2584 generic.go:356] "Generic (PLEG): container finished" podID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerID="296c9c2387c75c4aa94b4584480343d94ad6a6f1974de49428f2dce0656b30d7" exitCode=0
Sep 19 04:18:03.300102 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:03.299668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv" event={"ID":"325b85fd-ddc2-4df9-9336-6c6a4160e666","Type":"ContainerDied","Data":"296c9c2387c75c4aa94b4584480343d94ad6a6f1974de49428f2dce0656b30d7"}
Sep 19 04:18:05.313066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:05.313026    2584 generic.go:356] "Generic (PLEG): container finished" podID="c3304300-278a-494f-ac29-056ad7d71f6e" containerID="8f06c2d05cec8ddd6b55ee5a46cecbfc4bda0a69e7b238d023c5041a810f9b39" exitCode=0
Sep 19 04:18:05.313555 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:05.313106    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc" event={"ID":"c3304300-278a-494f-ac29-056ad7d71f6e","Type":"ContainerDied","Data":"8f06c2d05cec8ddd6b55ee5a46cecbfc4bda0a69e7b238d023c5041a810f9b39"}
Sep 19 04:18:11.345566 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:11.345525    2584 generic.go:356] "Generic (PLEG): container finished" podID="c3304300-278a-494f-ac29-056ad7d71f6e" containerID="a20208b0d286af02010e47ffc2845d8ea54d655a0998bfd1a0db71ea2874db6c" exitCode=0
Sep 19 04:18:11.346003 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:11.345611    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc" event={"ID":"c3304300-278a-494f-ac29-056ad7d71f6e","Type":"ContainerDied","Data":"a20208b0d286af02010e47ffc2845d8ea54d655a0998bfd1a0db71ea2874db6c"}
Sep 19 04:18:11.347587 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:11.347560    2584 generic.go:356] "Generic (PLEG): container finished" podID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerID="0955128b7002210ec3cf3ea2228a9d8c7db77171202b4d72056c85d6b48061d6" exitCode=0
Sep 19 04:18:11.347661 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:11.347599    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv" event={"ID":"325b85fd-ddc2-4df9-9336-6c6a4160e666","Type":"ContainerDied","Data":"0955128b7002210ec3cf3ea2228a9d8c7db77171202b4d72056c85d6b48061d6"}
Sep 19 04:18:12.481877 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.481848    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:18:12.512172 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.512141    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:18:12.581023 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.580993    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle\") pod \"325b85fd-ddc2-4df9-9336-6c6a4160e666\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") "
Sep 19 04:18:12.581023 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581024    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util\") pod \"325b85fd-ddc2-4df9-9336-6c6a4160e666\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") "
Sep 19 04:18:12.581265 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581044    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util\") pod \"c3304300-278a-494f-ac29-056ad7d71f6e\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") "
Sep 19 04:18:12.581265 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581070    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9vwmk\" (UniqueName: \"kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk\") pod \"c3304300-278a-494f-ac29-056ad7d71f6e\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") "
Sep 19 04:18:12.581265 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581105    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqbgd\" (UniqueName: \"kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd\") pod \"325b85fd-ddc2-4df9-9336-6c6a4160e666\" (UID: \"325b85fd-ddc2-4df9-9336-6c6a4160e666\") "
Sep 19 04:18:12.581265 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581183    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle\") pod \"c3304300-278a-494f-ac29-056ad7d71f6e\" (UID: \"c3304300-278a-494f-ac29-056ad7d71f6e\") "
Sep 19 04:18:12.581646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581618    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle" (OuterVolumeSpecName: "bundle") pod "c3304300-278a-494f-ac29-056ad7d71f6e" (UID: "c3304300-278a-494f-ac29-056ad7d71f6e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:18:12.581738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.581719    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle" (OuterVolumeSpecName: "bundle") pod "325b85fd-ddc2-4df9-9336-6c6a4160e666" (UID: "325b85fd-ddc2-4df9-9336-6c6a4160e666"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:18:12.583446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.583420    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd" (OuterVolumeSpecName: "kube-api-access-zqbgd") pod "325b85fd-ddc2-4df9-9336-6c6a4160e666" (UID: "325b85fd-ddc2-4df9-9336-6c6a4160e666"). InnerVolumeSpecName "kube-api-access-zqbgd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:18:12.583560 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.583547    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk" (OuterVolumeSpecName: "kube-api-access-9vwmk") pod "c3304300-278a-494f-ac29-056ad7d71f6e" (UID: "c3304300-278a-494f-ac29-056ad7d71f6e"). InnerVolumeSpecName "kube-api-access-9vwmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:18:12.587359 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.587339    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util" (OuterVolumeSpecName: "util") pod "c3304300-278a-494f-ac29-056ad7d71f6e" (UID: "c3304300-278a-494f-ac29-056ad7d71f6e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:18:12.588499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.588477    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util" (OuterVolumeSpecName: "util") pod "325b85fd-ddc2-4df9-9336-6c6a4160e666" (UID: "325b85fd-ddc2-4df9-9336-6c6a4160e666"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681779    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-bundle\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681806    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/325b85fd-ddc2-4df9-9336-6c6a4160e666-util\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681815    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-util\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681823    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9vwmk\" (UniqueName: \"kubernetes.io/projected/c3304300-278a-494f-ac29-056ad7d71f6e-kube-api-access-9vwmk\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681833    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqbgd\" (UniqueName: \"kubernetes.io/projected/325b85fd-ddc2-4df9-9336-6c6a4160e666-kube-api-access-zqbgd\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:12.681860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:12.681841    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c3304300-278a-494f-ac29-056ad7d71f6e-bundle\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:18:13.357688 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.357658    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc"
Sep 19 04:18:13.357886 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.357692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78e47bgc" event={"ID":"c3304300-278a-494f-ac29-056ad7d71f6e","Type":"ContainerDied","Data":"2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836"}
Sep 19 04:18:13.357886 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.357746    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2f0959812e333d964db9946ce6a2732946e5afa5fe0b7c9de16a535d34c19836"
Sep 19 04:18:13.359561 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.359536    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv"
Sep 19 04:18:13.359561 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.359536    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/978bd81eed4c4dc7896cbc7c21ae91125ef0d2dcd9abf7d17f5d8e954encddv" event={"ID":"325b85fd-ddc2-4df9-9336-6c6a4160e666","Type":"ContainerDied","Data":"876fd0c76e772b6d4c71e45dc36acb634aee18f28f9d3abb39a1f2366cfcb7f6"}
Sep 19 04:18:13.359709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:13.359579    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="876fd0c76e772b6d4c71e45dc36acb634aee18f28f9d3abb39a1f2366cfcb7f6"
Sep 19 04:18:23.236374 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236337    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"]
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236681    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="util"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236692    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="util"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236703    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="util"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236709    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="util"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236716    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="pull"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236721    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="pull"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236730    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="pull"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236736    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="pull"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236744    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="extract"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236749    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="extract"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236758    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="extract"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236762    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="extract"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236817    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3304300-278a-494f-ac29-056ad7d71f6e" containerName="extract"
Sep 19 04:18:23.236820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.236828    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="325b85fd-ddc2-4df9-9336-6c6a4160e666" containerName="extract"
Sep 19 04:18:23.253392 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.253369    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.260824 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.260796    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 19 04:18:23.261581 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.261557    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Sep 19 04:18:23.261718 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.261583    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Sep 19 04:18:23.261718 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.261639    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-6cqv5\""
Sep 19 04:18:23.261718 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.261569    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Sep 19 04:18:23.262023 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.262007    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 19 04:18:23.263103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.263079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"]
Sep 19 04:18:23.371139 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371107    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.371139 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371144    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.371350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371204    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.371350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371247    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.371350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371303    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4q5\" (UniqueName: \"kubernetes.io/projected/40512e0f-b114-4f30-b788-157f1a07391d-kube-api-access-vs4q5\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.371451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.371375    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472488    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4q5\" (UniqueName: \"kubernetes.io/projected/40512e0f-b114-4f30-b788-157f1a07391d-kube-api-access-vs4q5\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472565    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472744    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472781    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.472950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.472824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.473189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.473160    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-manifests\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.475254 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.475225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40512e0f-b114-4f30-b788-157f1a07391d-tmp\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.475378 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.475334    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.475378 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.475355    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-webhook-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.475378 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.475364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/40512e0f-b114-4f30-b788-157f1a07391d-metrics-cert\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.484340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.484292    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4q5\" (UniqueName: \"kubernetes.io/projected/40512e0f-b114-4f30-b788-157f1a07391d-kube-api-access-vs4q5\") pod \"opendatahub-operator-controller-manager-fc5f7b9db-jlptp\" (UID: \"40512e0f-b114-4f30-b788-157f1a07391d\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.564542 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.564512    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:23.867684 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:23.867605    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"]
Sep 19 04:18:23.871519 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:18:23.871491    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40512e0f_b114_4f30_b788_157f1a07391d.slice/crio-9cf6392b21eb5a2820c3093d8f30783420bc9f192e5548785a3f307d5966a97a WatchSource:0}: Error finding container 9cf6392b21eb5a2820c3093d8f30783420bc9f192e5548785a3f307d5966a97a: Status 404 returned error can't find the container with id 9cf6392b21eb5a2820c3093d8f30783420bc9f192e5548785a3f307d5966a97a
Sep 19 04:18:24.403154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:24.403121    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp" event={"ID":"40512e0f-b114-4f30-b788-157f1a07391d","Type":"ContainerStarted","Data":"9cf6392b21eb5a2820c3093d8f30783420bc9f192e5548785a3f307d5966a97a"}
Sep 19 04:18:27.424490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:27.424454    2584 generic.go:356] "Generic (PLEG): container finished" podID="40512e0f-b114-4f30-b788-157f1a07391d" containerID="348c39e25bee52bbb4c64561732faf37945335e4c35a8e416b0f89beff2fb41b" exitCode=0
Sep 19 04:18:27.424835 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:27.424497    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp" event={"ID":"40512e0f-b114-4f30-b788-157f1a07391d","Type":"ContainerDied","Data":"348c39e25bee52bbb4c64561732faf37945335e4c35a8e416b0f89beff2fb41b"}
Sep 19 04:18:28.431021 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:28.430977    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp" event={"ID":"40512e0f-b114-4f30-b788-157f1a07391d","Type":"ContainerStarted","Data":"efc468af47b3c2dec93ac5a9d1f431b869c784640e9aab1012197a43293929ab"}
Sep 19 04:18:28.431517 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:28.431123    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:28.458939 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:28.458886    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp" podStartSLOduration=1.76912888 podStartE2EDuration="5.458869868s" totalImagesPullingTime="3.252015609s" totalInitContainerRuntime="437.725379ms" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:28.457331256 +0000 UTC m=+296.991312695" watchObservedRunningTime="2026-09-19 04:18:28.458869868 +0000 UTC m=+296.992851306"
Sep 19 04:18:31.831205 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:31.831180    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:18:31.834462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:31.834433    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:18:31.842023 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:31.841994    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 19 04:18:39.438080 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:39.438048    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-fc5f7b9db-jlptp"
Sep 19 04:18:48.432777 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.432739    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"]
Sep 19 04:18:48.435997 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.435979    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.438523 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.438499    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 19 04:18:48.439679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.439661    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 19 04:18:48.440698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.440680    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 19 04:18:48.441290 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.441242    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 19 04:18:48.442118 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.442094    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-l7p6r\""
Sep 19 04:18:48.458733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.458714    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"]
Sep 19 04:18:48.474225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.474203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kpvr\" (UniqueName: \"kubernetes.io/projected/64159ef5-3911-474f-b33b-9d04df17f28a-kube-api-access-8kpvr\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.474345 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.474233    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64159ef5-3911-474f-b33b-9d04df17f28a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.474345 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.474263    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64159ef5-3911-474f-b33b-9d04df17f28a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.575222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.575198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kpvr\" (UniqueName: \"kubernetes.io/projected/64159ef5-3911-474f-b33b-9d04df17f28a-kube-api-access-8kpvr\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.575405 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.575228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64159ef5-3911-474f-b33b-9d04df17f28a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.575405 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.575250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64159ef5-3911-474f-b33b-9d04df17f28a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.575841 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.575823    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/64159ef5-3911-474f-b33b-9d04df17f28a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.577812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.577794    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/64159ef5-3911-474f-b33b-9d04df17f28a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.593293 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.593255    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kpvr\" (UniqueName: \"kubernetes.io/projected/64159ef5-3911-474f-b33b-9d04df17f28a-kube-api-access-8kpvr\") pod \"kuadrant-console-plugin-fbdd4f445-spj2r\" (UID: \"64159ef5-3911-474f-b33b-9d04df17f28a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:48.771684 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:48.771594    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"
Sep 19 04:18:49.055158 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:49.055128    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r"]
Sep 19 04:18:49.058437 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:18:49.058408    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod64159ef5_3911_474f_b33b_9d04df17f28a.slice/crio-2142e893feeeb2f6ea8ab1432643490d027eaf013e62ef9f0ea35302f8cc293e WatchSource:0}: Error finding container 2142e893feeeb2f6ea8ab1432643490d027eaf013e62ef9f0ea35302f8cc293e: Status 404 returned error can't find the container with id 2142e893feeeb2f6ea8ab1432643490d027eaf013e62ef9f0ea35302f8cc293e
Sep 19 04:18:49.060098 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:49.060080    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:18:49.526899 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:49.526810    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r" event={"ID":"64159ef5-3911-474f-b33b-9d04df17f28a","Type":"ContainerStarted","Data":"2142e893feeeb2f6ea8ab1432643490d027eaf013e62ef9f0ea35302f8cc293e"}
Sep 19 04:18:53.874422 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.874386    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-xzqlq"]
Sep 19 04:18:53.883982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.883959    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:53.899522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.899499    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 19 04:18:53.899715 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.899697    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 19 04:18:53.911383 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.911056    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-prgcf\""
Sep 19 04:18:53.919658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.919631    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/54897523-3257-42b3-91c9-9ec0a2d96a54-kube-api-access-xq9gd\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:53.919658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.919653    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-xzqlq"]
Sep 19 04:18:53.919851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.919678    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54897523-3257-42b3-91c9-9ec0a2d96a54-tmp\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:53.919851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:53.919758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54897523-3257-42b3-91c9-9ec0a2d96a54-tls-certs\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.021862 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.021795    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/54897523-3257-42b3-91c9-9ec0a2d96a54-kube-api-access-xq9gd\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.022720 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.022349    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54897523-3257-42b3-91c9-9ec0a2d96a54-tmp\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.022720 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.022444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54897523-3257-42b3-91c9-9ec0a2d96a54-tls-certs\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.031133 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.031073    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/54897523-3257-42b3-91c9-9ec0a2d96a54-tmp\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.033420 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.033395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/54897523-3257-42b3-91c9-9ec0a2d96a54-tls-certs\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.048577 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.048556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xq9gd\" (UniqueName: \"kubernetes.io/projected/54897523-3257-42b3-91c9-9ec0a2d96a54-kube-api-access-xq9gd\") pod \"kube-auth-proxy-6644598669-xzqlq\" (UID: \"54897523-3257-42b3-91c9-9ec0a2d96a54\") " pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.198541 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.198126    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq"
Sep 19 04:18:54.498563 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.498537    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6644598669-xzqlq"]
Sep 19 04:18:54.500552 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:18:54.500518    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54897523_3257_42b3_91c9_9ec0a2d96a54.slice/crio-37bdaf11ab8217a08d3cff4fe74e4d21a65ef812b7bce16db03e6f379ac159f9 WatchSource:0}: Error finding container 37bdaf11ab8217a08d3cff4fe74e4d21a65ef812b7bce16db03e6f379ac159f9: Status 404 returned error can't find the container with id 37bdaf11ab8217a08d3cff4fe74e4d21a65ef812b7bce16db03e6f379ac159f9
Sep 19 04:18:54.554310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.554258    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r" event={"ID":"64159ef5-3911-474f-b33b-9d04df17f28a","Type":"ContainerStarted","Data":"481eb1dd26a1eeafa392ccf13d7b1f1295bf317563304a4800025e2b59424443"}
Sep 19 04:18:54.555512 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.555490    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq" event={"ID":"54897523-3257-42b3-91c9-9ec0a2d96a54","Type":"ContainerStarted","Data":"37bdaf11ab8217a08d3cff4fe74e4d21a65ef812b7bce16db03e6f379ac159f9"}
Sep 19 04:18:54.576427 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:54.576384    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-spj2r" podStartSLOduration=1.436609126 podStartE2EDuration="6.576367015s" totalImagesPullingTime="5.139757889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:54.575491014 +0000 UTC m=+323.109472453" watchObservedRunningTime="2026-09-19 04:18:54.576367015 +0000 UTC m=+323.110348452"
Sep 19 04:18:57.574792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:57.574754    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq" event={"ID":"54897523-3257-42b3-91c9-9ec0a2d96a54","Type":"ContainerStarted","Data":"b0a0a5de41741fe66afc18d3ec4a0e5bbbf90132329f6dcfeb261981c53379c0"}
Sep 19 04:18:57.603521 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:18:57.603468    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6644598669-xzqlq" podStartSLOduration=2.116211591 podStartE2EDuration="4.603452453s" totalImagesPullingTime="2.487240862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:18:57.602623899 +0000 UTC m=+326.136605337" watchObservedRunningTime="2026-09-19 04:18:57.603452453 +0000 UTC m=+326.137433890"
Sep 19 04:19:52.255527 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.255491    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"]
Sep 19 04:19:52.258736 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.258719    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.280946 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:19:52.280910    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kserve-controller-manager-7645b9c6f5-rmmc8\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" podUID="ef0d23b8-e700-441e-8aa4-681420b0f32c" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.281693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.281676    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 19 04:19:52.281693 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.281687    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 19 04:19:52.281830 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.281676    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 19 04:19:52.287536 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:19:52.287514    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"kserve-controller-manager-dockercfg-8pxlb\" is forbidden: User \"system:node:ip-10-0-139-253.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-253.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8pxlb\"" type="*v1.Secret"
Sep 19 04:19:52.294802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.294770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"]
Sep 19 04:19:52.322923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.322899    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0d23b8-e700-441e-8aa4-681420b0f32c-cert\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.323012 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.322938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p75xl\" (UniqueName: \"kubernetes.io/projected/ef0d23b8-e700-441e-8aa4-681420b0f32c-kube-api-access-p75xl\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.423612 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.423574    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0d23b8-e700-441e-8aa4-681420b0f32c-cert\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.423612 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.423615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p75xl\" (UniqueName: \"kubernetes.io/projected/ef0d23b8-e700-441e-8aa4-681420b0f32c-kube-api-access-p75xl\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.426233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.426203    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ef0d23b8-e700-441e-8aa4-681420b0f32c-cert\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:52.465753 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:52.465722    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p75xl\" (UniqueName: \"kubernetes.io/projected/ef0d23b8-e700-441e-8aa4-681420b0f32c-kube-api-access-p75xl\") pod \"kserve-controller-manager-7645b9c6f5-rmmc8\" (UID: \"ef0d23b8-e700-441e-8aa4-681420b0f32c\") " pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:53.290891 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.290860    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"]
Sep 19 04:19:53.294353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.294332    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.324406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.324379    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"]
Sep 19 04:19:53.432580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432547    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv5l6\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-kube-api-access-xv5l6\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432794 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432603    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432794 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432694    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/32098fc4-3b74-40d5-8e34-5319105945ae-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432794 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432720    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432794 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432745    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.432938 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.432828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534090 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534105    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv5l6\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-kube-api-access-xv5l6\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534127    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534204    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/32098fc4-3b74-40d5-8e34-5319105945ae-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.534900 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.534873    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.536805 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.536776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.537080 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.537052    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.537185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.537122    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/32098fc4-3b74-40d5-8e34-5319105945ae-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.537338 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.537317    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/32098fc4-3b74-40d5-8e34-5319105945ae-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.547580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.547524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.548042 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.548019    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv5l6\" (UniqueName: \"kubernetes.io/projected/32098fc4-3b74-40d5-8e34-5319105945ae-kube-api-access-xv5l6\") pod \"istiod-openshift-gateway-5677ccb49b-dwnc4\" (UID: \"32098fc4-3b74-40d5-8e34-5319105945ae\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.569515 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.569488    2584 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8" secret="" err="failed to sync secret cache: timed out waiting for the condition"
Sep 19 04:19:53.569650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.569581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:53.608651 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.608560    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:53.787640 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.787612    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-8pxlb\""
Sep 19 04:19:53.851490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.851467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"]
Sep 19 04:19:53.853014 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:19:53.852983    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef0d23b8_e700_441e_8aa4_681420b0f32c.slice/crio-5391976a2b37a7c2a193fd26e235f402a6b0e01490ab48dc6234c2ff83c20fd1 WatchSource:0}: Error finding container 5391976a2b37a7c2a193fd26e235f402a6b0e01490ab48dc6234c2ff83c20fd1: Status 404 returned error can't find the container with id 5391976a2b37a7c2a193fd26e235f402a6b0e01490ab48dc6234c2ff83c20fd1
Sep 19 04:19:53.912348 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.912198    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"]
Sep 19 04:19:53.914472 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:19:53.914441    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32098fc4_3b74_40d5_8e34_5319105945ae.slice/crio-abeed931bcbfe3d6fffa6ab1b7c0e77862950701010b3018998dcbbce17b084a WatchSource:0}: Error finding container abeed931bcbfe3d6fffa6ab1b7c0e77862950701010b3018998dcbbce17b084a: Status 404 returned error can't find the container with id abeed931bcbfe3d6fffa6ab1b7c0e77862950701010b3018998dcbbce17b084a
Sep 19 04:19:53.916638 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.916607    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:19:53.916738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:53.916663    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:19:54.837506 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.837471    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4" event={"ID":"32098fc4-3b74-40d5-8e34-5319105945ae","Type":"ContainerStarted","Data":"60d7a3b709102cf4f2d71f5d86617246a9f0425b6fd6515bbf79733476199254"}
Sep 19 04:19:54.837936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.837521    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4" event={"ID":"32098fc4-3b74-40d5-8e34-5319105945ae","Type":"ContainerStarted","Data":"abeed931bcbfe3d6fffa6ab1b7c0e77862950701010b3018998dcbbce17b084a"}
Sep 19 04:19:54.838057 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.838037    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:54.839233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.839199    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8" event={"ID":"ef0d23b8-e700-441e-8aa4-681420b0f32c","Type":"ContainerStarted","Data":"5391976a2b37a7c2a193fd26e235f402a6b0e01490ab48dc6234c2ff83c20fd1"}
Sep 19 04:19:54.839826 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.839799    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4"
Sep 19 04:19:54.891051 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:54.890999    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-dwnc4" podStartSLOduration=1.8909800940000001 podStartE2EDuration="1.890980094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:19:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:19:54.888956834 +0000 UTC m=+383.422938283" watchObservedRunningTime="2026-09-19 04:19:54.890980094 +0000 UTC m=+383.424961534"
Sep 19 04:19:55.017960 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:55.017825    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:19:55.018126 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:55.018039    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerName="discovery" containerID="cri-o://45d34fc7a14c2c24576dcb83feeb0846e11a2f1c4414348b49715924a8d49975" gracePeriod=30
Sep 19 04:19:55.845633 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:55.845596    2584 generic.go:356] "Generic (PLEG): container finished" podID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerID="45d34fc7a14c2c24576dcb83feeb0846e11a2f1c4414348b49715924a8d49975" exitCode=0
Sep 19 04:19:55.846009 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:55.845665    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" event={"ID":"941fb747-0d4e-4dd3-85ac-cad3ae03e287","Type":"ContainerDied","Data":"45d34fc7a14c2c24576dcb83feeb0846e11a2f1c4414348b49715924a8d49975"}
Sep 19 04:19:56.572233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.572211    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:19:56.664654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664628    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.664842 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664676    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.664842 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664702    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.664842 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664727    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.664842 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664802    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.665051 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664866    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.665051 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.664942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqz4s\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s\") pod \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\" (UID: \"941fb747-0d4e-4dd3-85ac-cad3ae03e287\") "
Sep 19 04:19:56.665442 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.665396    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:19:56.667463 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667413    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs" (OuterVolumeSpecName: "local-certs") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:19:56.667551 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667497    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s" (OuterVolumeSpecName: "kube-api-access-jqz4s") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "kube-api-access-jqz4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:19:56.667551 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667526    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:19:56.667767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667745    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:19:56.667767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667754    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token" (OuterVolumeSpecName: "istio-token") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:19:56.667767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.667759    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts" (OuterVolumeSpecName: "cacerts") pod "941fb747-0d4e-4dd3-85ac-cad3ae03e287" (UID: "941fb747-0d4e-4dd3-85ac-cad3ae03e287"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:19:56.765719 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765680    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqz4s\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-kube-api-access-jqz4s\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765719 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765721    2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/941fb747-0d4e-4dd3-85ac-cad3ae03e287-local-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765735    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765743    2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-kubeconfig\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765750    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-ca-configmap\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765759    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-istio-csr-dns-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.765913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.765766    2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/941fb747-0d4e-4dd3-85ac-cad3ae03e287-cacerts\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:19:56.851669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.851640    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"
Sep 19 04:19:56.852066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.851673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6" event={"ID":"941fb747-0d4e-4dd3-85ac-cad3ae03e287","Type":"ContainerDied","Data":"ae75098e3c2c99b975c4a2cbcc49aa68bcf17c034bba8741b90cb0a1b30accf4"}
Sep 19 04:19:56.852066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.851735    2584 scope.go:117] "RemoveContainer" containerID="45d34fc7a14c2c24576dcb83feeb0846e11a2f1c4414348b49715924a8d49975"
Sep 19 04:19:56.853470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.853440    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8" event={"ID":"ef0d23b8-e700-441e-8aa4-681420b0f32c","Type":"ContainerStarted","Data":"523e6e8a7107e286f09b07e5a072314844d5b3a5d7c82fee798683f8668ffe03"}
Sep 19 04:19:56.924049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.923956    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8" podStartSLOduration=2.301620688 podStartE2EDuration="4.923941379s" totalImagesPullingTime="2.622320691s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:19:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:19:56.897175017 +0000 UTC m=+385.431156452" watchObservedRunningTime="2026-09-19 04:19:56.923941379 +0000 UTC m=+385.457922817"
Sep 19 04:19:56.925473 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.925454    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:19:56.933948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:56.933924    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-5b7l6"]
Sep 19 04:19:57.860786 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:57.860754    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:19:57.966967 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:19:57.966928    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" path="/var/lib/kubelet/pods/941fb747-0d4e-4dd3-85ac-cad3ae03e287/volumes"
Sep 19 04:20:28.870347 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:20:28.870317    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-7645b9c6f5-rmmc8"
Sep 19 04:23:31.862991 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:23:31.862966    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:23:31.870083 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:23:31.870062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:28:31.894570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:28:31.894538    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:28:31.897343 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:28:31.897316    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:29:28.712580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.712548    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:28.712984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.712874    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerName="discovery"
Sep 19 04:29:28.712984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.712886    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerName="discovery"
Sep 19 04:29:28.712984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.712943    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="941fb747-0d4e-4dd3-85ac-cad3ae03e287" containerName="discovery"
Sep 19 04:29:28.715833 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.715815    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.718504 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.718486    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 19 04:29:28.729980 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.729958    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:28.785301 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.785246    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.785470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.785388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rlt\" (UniqueName: \"kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.813097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.813059    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:28.885880 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.885851    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rlt\" (UniqueName: \"kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.886025 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.885919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.886570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.886552    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:28.894606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:28.894586    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rlt\" (UniqueName: \"kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt\") pod \"limitador-limitador-8588749977-nckd9\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") " pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:29.025873 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.025787    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:29.193919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.193882    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:29:29.197401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.197378    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.207434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.207411    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:29:29.246862 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.246324    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:29:29.289493 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.289468    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs7bs\" (UniqueName: \"kubernetes.io/projected/bb40659b-b16b-47af-86e0-5630ba20859f-kube-api-access-cs7bs\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.289618 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.289509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb40659b-b16b-47af-86e0-5630ba20859f-config-file\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.300250 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.300173    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:29.302536 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:29:29.302512    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947689fa_76ae_4917_bb48_25eabb915356.slice/crio-a10a6ec4cf1a4735f8dcd7be3e4f86267b6cd24fe161dd42fc71467de5393fd4 WatchSource:0}: Error finding container a10a6ec4cf1a4735f8dcd7be3e4f86267b6cd24fe161dd42fc71467de5393fd4: Status 404 returned error can't find the container with id a10a6ec4cf1a4735f8dcd7be3e4f86267b6cd24fe161dd42fc71467de5393fd4
Sep 19 04:29:29.304256 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.304240    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:29:29.390868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.390837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs7bs\" (UniqueName: \"kubernetes.io/projected/bb40659b-b16b-47af-86e0-5630ba20859f-kube-api-access-cs7bs\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.391004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.390883    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb40659b-b16b-47af-86e0-5630ba20859f-config-file\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.391509 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.391492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bb40659b-b16b-47af-86e0-5630ba20859f-config-file\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.399848 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.399816    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs7bs\" (UniqueName: \"kubernetes.io/projected/bb40659b-b16b-47af-86e0-5630ba20859f-kube-api-access-cs7bs\") pod \"limitador-limitador-84994f7ffc-nf7j6\" (UID: \"bb40659b-b16b-47af-86e0-5630ba20859f\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.408604 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.408577    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" event={"ID":"947689fa-76ae-4917-bb48-25eabb915356","Type":"ContainerStarted","Data":"a10a6ec4cf1a4735f8dcd7be3e4f86267b6cd24fe161dd42fc71467de5393fd4"}
Sep 19 04:29:29.508770 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.508725    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:29.781184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:29.781122    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:29:29.783722 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:29:29.783695    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb40659b_b16b_47af_86e0_5630ba20859f.slice/crio-87c739fb58bfd17822d3e8c437f7f6ff176c6093464ebdb30296d10df874b708 WatchSource:0}: Error finding container 87c739fb58bfd17822d3e8c437f7f6ff176c6093464ebdb30296d10df874b708: Status 404 returned error can't find the container with id 87c739fb58bfd17822d3e8c437f7f6ff176c6093464ebdb30296d10df874b708
Sep 19 04:29:30.417435 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:30.417379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6" event={"ID":"bb40659b-b16b-47af-86e0-5630ba20859f","Type":"ContainerStarted","Data":"87c739fb58bfd17822d3e8c437f7f6ff176c6093464ebdb30296d10df874b708"}
Sep 19 04:29:31.422969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.422936    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" event={"ID":"947689fa-76ae-4917-bb48-25eabb915356","Type":"ContainerStarted","Data":"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"}
Sep 19 04:29:31.423459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.423018    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:31.424533 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.424503    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6" event={"ID":"bb40659b-b16b-47af-86e0-5630ba20859f","Type":"ContainerStarted","Data":"9943cf7a9bc1c719e3884c48beae8469aad68d7ca4737ce70d1d63718b0bdeb4"}
Sep 19 04:29:31.424630 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.424557    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:31.441801 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.441758    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" podStartSLOduration=2.0730729390000002 podStartE2EDuration="3.441744302s" totalImagesPullingTime="1.368671363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:29:31.439773673 +0000 UTC m=+959.973755111" watchObservedRunningTime="2026-09-19 04:29:31.441744302 +0000 UTC m=+959.975725739"
Sep 19 04:29:31.459785 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:31.459747    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6" podStartSLOduration=1.570597052 podStartE2EDuration="2.459735314s" totalImagesPullingTime="889.138262ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:29:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:29:31.458326467 +0000 UTC m=+959.992307927" watchObservedRunningTime="2026-09-19 04:29:31.459735314 +0000 UTC m=+959.993716785"
Sep 19 04:29:42.430197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:42.430171    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"
Sep 19 04:29:42.430584 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:42.430241    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:42.510646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:42.510608    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:42.510839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:42.510814    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" podUID="947689fa-76ae-4917-bb48-25eabb915356" containerName="limitador" containerID="cri-o://06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e" gracePeriod=30
Sep 19 04:29:43.059258 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.059235    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:43.207873 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.207791    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file\") pod \"947689fa-76ae-4917-bb48-25eabb915356\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") "
Sep 19 04:29:43.207873 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.207858    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4rlt\" (UniqueName: \"kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt\") pod \"947689fa-76ae-4917-bb48-25eabb915356\" (UID: \"947689fa-76ae-4917-bb48-25eabb915356\") "
Sep 19 04:29:43.208143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.208123    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file" (OuterVolumeSpecName: "config-file") pod "947689fa-76ae-4917-bb48-25eabb915356" (UID: "947689fa-76ae-4917-bb48-25eabb915356"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:29:43.210251 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.210216    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt" (OuterVolumeSpecName: "kube-api-access-l4rlt") pod "947689fa-76ae-4917-bb48-25eabb915356" (UID: "947689fa-76ae-4917-bb48-25eabb915356"). InnerVolumeSpecName "kube-api-access-l4rlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:29:43.309368 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.309335    2584 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/947689fa-76ae-4917-bb48-25eabb915356-config-file\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:29:43.309368 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.309362    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4rlt\" (UniqueName: \"kubernetes.io/projected/947689fa-76ae-4917-bb48-25eabb915356-kube-api-access-l4rlt\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:29:43.481615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.481515    2584 generic.go:356] "Generic (PLEG): container finished" podID="947689fa-76ae-4917-bb48-25eabb915356" containerID="06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e" exitCode=0
Sep 19 04:29:43.481615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.481562    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-8588749977-nckd9"
Sep 19 04:29:43.482070 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.481612    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" event={"ID":"947689fa-76ae-4917-bb48-25eabb915356","Type":"ContainerDied","Data":"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"}
Sep 19 04:29:43.482070 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.481661    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-8588749977-nckd9" event={"ID":"947689fa-76ae-4917-bb48-25eabb915356","Type":"ContainerDied","Data":"a10a6ec4cf1a4735f8dcd7be3e4f86267b6cd24fe161dd42fc71467de5393fd4"}
Sep 19 04:29:43.482070 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.481683    2584 scope.go:117] "RemoveContainer" containerID="06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"
Sep 19 04:29:43.490609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.490595    2584 scope.go:117] "RemoveContainer" containerID="06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"
Sep 19 04:29:43.490853 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:29:43.490835    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e\": container with ID starting with 06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e not found: ID does not exist" containerID="06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"
Sep 19 04:29:43.490902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.490863    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e"} err="failed to get container status \"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e\": rpc error: code = NotFound desc = could not find container \"06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e\": container with ID starting with 06f9c7f231f1b60297910b4c235c98a9e7de1e81e4cda074f087cbcd5bd8ea2e not found: ID does not exist"
Sep 19 04:29:43.503260 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.503237    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:43.505667 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.505647    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-8588749977-nckd9"]
Sep 19 04:29:43.966980 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:43.966946    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="947689fa-76ae-4917-bb48-25eabb915356" path="/var/lib/kubelet/pods/947689fa-76ae-4917-bb48-25eabb915356/volumes"
Sep 19 04:29:48.712847 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.712774    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"]
Sep 19 04:29:48.713185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.713108    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947689fa-76ae-4917-bb48-25eabb915356" containerName="limitador"
Sep 19 04:29:48.713185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.713118    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="947689fa-76ae-4917-bb48-25eabb915356" containerName="limitador"
Sep 19 04:29:48.713185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.713181    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="947689fa-76ae-4917-bb48-25eabb915356" containerName="limitador"
Sep 19 04:29:48.717597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.717577    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.720150 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.720115    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 19 04:29:48.720150 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.720115    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 19 04:29:48.720729 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.720712    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 19 04:29:48.720841 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.720740    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-7kjbw\""
Sep 19 04:29:48.726055 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.726035    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"]
Sep 19 04:29:48.857109 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.857073    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99c874bf-e7e7-4eb8-8869-1db918cbdb74-data\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.857292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.857125    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxjcl\" (UniqueName: \"kubernetes.io/projected/99c874bf-e7e7-4eb8-8869-1db918cbdb74-kube-api-access-rxjcl\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.957745 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.957707    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxjcl\" (UniqueName: \"kubernetes.io/projected/99c874bf-e7e7-4eb8-8869-1db918cbdb74-kube-api-access-rxjcl\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.957941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.957784    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99c874bf-e7e7-4eb8-8869-1db918cbdb74-data\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.958109 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.958091    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/99c874bf-e7e7-4eb8-8869-1db918cbdb74-data\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:48.966340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:48.966269    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxjcl\" (UniqueName: \"kubernetes.io/projected/99c874bf-e7e7-4eb8-8869-1db918cbdb74-kube-api-access-rxjcl\") pod \"postgres-69fb4594cf-g6pzf\" (UID: \"99c874bf-e7e7-4eb8-8869-1db918cbdb74\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:49.028050 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:49.028007    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:49.299529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:49.299502    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"]
Sep 19 04:29:49.304467 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:29:49.304440    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c874bf_e7e7_4eb8_8869_1db918cbdb74.slice/crio-5f86db91e82155ecd9adb7ce50eddd1815812e19709a941574dda82c3649c0c8 WatchSource:0}: Error finding container 5f86db91e82155ecd9adb7ce50eddd1815812e19709a941574dda82c3649c0c8: Status 404 returned error can't find the container with id 5f86db91e82155ecd9adb7ce50eddd1815812e19709a941574dda82c3649c0c8
Sep 19 04:29:49.511540 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:49.511508    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf" event={"ID":"99c874bf-e7e7-4eb8-8869-1db918cbdb74","Type":"ContainerStarted","Data":"5f86db91e82155ecd9adb7ce50eddd1815812e19709a941574dda82c3649c0c8"}
Sep 19 04:29:55.547616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:55.547580    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf" event={"ID":"99c874bf-e7e7-4eb8-8869-1db918cbdb74","Type":"ContainerStarted","Data":"182078dc1f625ffe3be8469cc84ecc24148a0bd4b022583c0b2b941e08a7cb01"}
Sep 19 04:29:55.548058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:55.547643    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:29:55.567454 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:29:55.567404    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf" podStartSLOduration=2.076306925 podStartE2EDuration="7.567386967s" totalImagesPullingTime="5.491080042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:29:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:29:55.565412365 +0000 UTC m=+984.099393814" watchObservedRunningTime="2026-09-19 04:29:55.567386967 +0000 UTC m=+984.101368402"
Sep 19 04:30:01.581840 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:01.581809    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-g6pzf"
Sep 19 04:30:42.549916 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.549876    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:30:42.554751 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.554729    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.557856 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.557837    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7pswq\""
Sep 19 04:30:42.557971 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.557861    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 04:30:42.557971 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.557846    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 04:30:42.568184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.568163    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:30:42.696404 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.696373    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.696588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.696413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.696588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.696447    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.696588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.696481    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbfzc\" (UniqueName: \"kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.797531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.797503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.797708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.797551    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.797708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.797588    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.797708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.797622    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbfzc\" (UniqueName: \"kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.798226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.798199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.800036 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.799977    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.800154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.800137    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.811575 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.811553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbfzc\" (UniqueName: \"kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc\") pod \"maas-api-d9c5bbd4f-5sk4j\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") " pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:42.865041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:42.865015    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:43.161534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:43.161460    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:30:43.163953 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:30:43.163928    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd643ac3b_b96c_4ba0_b585_f839fdee7134.slice/crio-8c8b3e394e0a1f656d1a99558ca6b3be924e62326857862a60afd17df1b267e5 WatchSource:0}: Error finding container 8c8b3e394e0a1f656d1a99558ca6b3be924e62326857862a60afd17df1b267e5: Status 404 returned error can't find the container with id 8c8b3e394e0a1f656d1a99558ca6b3be924e62326857862a60afd17df1b267e5
Sep 19 04:30:43.180534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:43.180496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:30:43.768771 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:43.768739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" event={"ID":"d643ac3b-b96c-4ba0-b585-f839fdee7134","Type":"ContainerStarted","Data":"8c8b3e394e0a1f656d1a99558ca6b3be924e62326857862a60afd17df1b267e5"}
Sep 19 04:30:45.780122 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:45.780085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" event={"ID":"d643ac3b-b96c-4ba0-b585-f839fdee7134","Type":"ContainerStarted","Data":"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"}
Sep 19 04:30:45.780509 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:45.780155    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:30:45.802474 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:45.802423    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" podStartSLOduration=2.080691926 podStartE2EDuration="3.802408296s" totalImagesPullingTime="1.72171637s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:30:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:30:45.80145007 +0000 UTC m=+1034.335431507" watchObservedRunningTime="2026-09-19 04:30:45.802408296 +0000 UTC m=+1034.336389734"
Sep 19 04:30:51.789846 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:30:51.789813    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:31:02.412590 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.412554    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:31:02.413009 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.412789    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" podUID="d643ac3b-b96c-4ba0-b585-f839fdee7134" containerName="maas-api" containerID="cri-o://101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e" gracePeriod=30
Sep 19 04:31:02.658790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.658766    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:31:02.673039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.672981    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs\") pod \"d643ac3b-b96c-4ba0-b585-f839fdee7134\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") "
Sep 19 04:31:02.673039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.673026    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbfzc\" (UniqueName: \"kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc\") pod \"d643ac3b-b96c-4ba0-b585-f839fdee7134\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") "
Sep 19 04:31:02.673219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.673046    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls\") pod \"d643ac3b-b96c-4ba0-b585-f839fdee7134\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") "
Sep 19 04:31:02.673219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.673064    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca\") pod \"d643ac3b-b96c-4ba0-b585-f839fdee7134\" (UID: \"d643ac3b-b96c-4ba0-b585-f839fdee7134\") "
Sep 19 04:31:02.673481 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.673452    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d643ac3b-b96c-4ba0-b585-f839fdee7134" (UID: "d643ac3b-b96c-4ba0-b585-f839fdee7134"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:31:02.675462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.675434    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc" (OuterVolumeSpecName: "kube-api-access-qbfzc") pod "d643ac3b-b96c-4ba0-b585-f839fdee7134" (UID: "d643ac3b-b96c-4ba0-b585-f839fdee7134"). InnerVolumeSpecName "kube-api-access-qbfzc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:31:02.675569 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.675466    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d643ac3b-b96c-4ba0-b585-f839fdee7134" (UID: "d643ac3b-b96c-4ba0-b585-f839fdee7134"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:31:02.675569 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.675482    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d643ac3b-b96c-4ba0-b585-f839fdee7134" (UID: "d643ac3b-b96c-4ba0-b585-f839fdee7134"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:31:02.773605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.773567    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d643ac3b-b96c-4ba0-b585-f839fdee7134-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:31:02.773605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.773596    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:31:02.773605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.773605    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbfzc\" (UniqueName: \"kubernetes.io/projected/d643ac3b-b96c-4ba0-b585-f839fdee7134-kube-api-access-qbfzc\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:31:02.773605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.773613    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d643ac3b-b96c-4ba0-b585-f839fdee7134-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:31:02.860195 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.860160    2584 generic.go:356] "Generic (PLEG): container finished" podID="d643ac3b-b96c-4ba0-b585-f839fdee7134" containerID="101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e" exitCode=0
Sep 19 04:31:02.860401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.860214    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"
Sep 19 04:31:02.860401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.860248    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" event={"ID":"d643ac3b-b96c-4ba0-b585-f839fdee7134","Type":"ContainerDied","Data":"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"}
Sep 19 04:31:02.860401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.860332    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j" event={"ID":"d643ac3b-b96c-4ba0-b585-f839fdee7134","Type":"ContainerDied","Data":"8c8b3e394e0a1f656d1a99558ca6b3be924e62326857862a60afd17df1b267e5"}
Sep 19 04:31:02.860401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.860356    2584 scope.go:117] "RemoveContainer" containerID="101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"
Sep 19 04:31:02.870039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.870021    2584 scope.go:117] "RemoveContainer" containerID="101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"
Sep 19 04:31:02.870342 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:31:02.870299    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e\": container with ID starting with 101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e not found: ID does not exist" containerID="101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"
Sep 19 04:31:02.870434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.870351    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e"} err="failed to get container status \"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e\": rpc error: code = NotFound desc = could not find container \"101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e\": container with ID starting with 101d604bf380d285278d955383e42e91f79edafbdea07a83b670c18cb74e9c4e not found: ID does not exist"
Sep 19 04:31:02.884824 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.884802    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:31:02.889536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:02.889516    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-d9c5bbd4f-5sk4j"]
Sep 19 04:31:03.966615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:03.966583    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d643ac3b-b96c-4ba0-b585-f839fdee7134" path="/var/lib/kubelet/pods/d643ac3b-b96c-4ba0-b585-f839fdee7134/volumes"
Sep 19 04:31:05.565624 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.565590    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"]
Sep 19 04:31:05.565982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.565923    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d643ac3b-b96c-4ba0-b585-f839fdee7134" containerName="maas-api"
Sep 19 04:31:05.565982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.565937    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d643ac3b-b96c-4ba0-b585-f839fdee7134" containerName="maas-api"
Sep 19 04:31:05.566063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.566015    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d643ac3b-b96c-4ba0-b585-f839fdee7134" containerName="maas-api"
Sep 19 04:31:05.569992 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.569975    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.577346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.577328    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 19 04:31:05.578077 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.578061    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 19 04:31:05.578153 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.578102    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lbmbg\""
Sep 19 04:31:05.578341 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.578323    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 19 04:31:05.589028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.589006    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"]
Sep 19 04:31:05.597207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6dpk\" (UniqueName: \"kubernetes.io/projected/39084546-7de1-4c9e-b487-bedb0974c329-kube-api-access-j6dpk\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.597323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597216    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.597323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597252    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.597323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.597463 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39084546-7de1-4c9e-b487-bedb0974c329-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.597463 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.597387    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.697969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.697935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.697980    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698032    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39084546-7de1-4c9e-b487-bedb0974c329-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698074    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698152 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698128    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6dpk\" (UniqueName: \"kubernetes.io/projected/39084546-7de1-4c9e-b487-bedb0974c329-kube-api-access-j6dpk\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698365 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698161    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698495    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-home\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698581 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698520    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.698581 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.698568    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-model-cache\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.700396 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.700377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/39084546-7de1-4c9e-b487-bedb0974c329-dshm\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.700712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.700694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/39084546-7de1-4c9e-b487-bedb0974c329-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.706888 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.706867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6dpk\" (UniqueName: \"kubernetes.io/projected/39084546-7de1-4c9e-b487-bedb0974c329-kube-api-access-j6dpk\") pod \"e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q\" (UID: \"39084546-7de1-4c9e-b487-bedb0974c329\") " pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:05.880318 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:05.880211    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:06.151388 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:06.151311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:31:06.159104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:06.159082    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"]
Sep 19 04:31:06.161101 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:31:06.161066    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39084546_7de1_4c9e_b487_bedb0974c329.slice/crio-1596426f99f460e7c3940dbd6fc0d74547ab7f0641377bee1780a16d5787e1ba WatchSource:0}: Error finding container 1596426f99f460e7c3940dbd6fc0d74547ab7f0641377bee1780a16d5787e1ba: Status 404 returned error can't find the container with id 1596426f99f460e7c3940dbd6fc0d74547ab7f0641377bee1780a16d5787e1ba
Sep 19 04:31:06.881337 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:06.881301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q" event={"ID":"39084546-7de1-4c9e-b487-bedb0974c329","Type":"ContainerStarted","Data":"1596426f99f460e7c3940dbd6fc0d74547ab7f0641377bee1780a16d5787e1ba"}
Sep 19 04:31:07.887792 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:07.887755    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q" event={"ID":"39084546-7de1-4c9e-b487-bedb0974c329","Type":"ContainerStarted","Data":"d727963014eabe683bb13010fb813cf9a53620e995d779c1419b8d0efafc101b"}
Sep 19 04:31:07.906907 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:07.906858    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q" podStartSLOduration=1.7953331270000001 podStartE2EDuration="2.906842569s" totalImagesPullingTime="1.111509442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:31:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:31:07.905316659 +0000 UTC m=+1056.439298096" watchObservedRunningTime="2026-09-19 04:31:07.906842569 +0000 UTC m=+1056.440824008"
Sep 19 04:31:08.881177 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:08.881147    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:15.881358 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:15.881320    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:15.893519 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:15.893497    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:15.937541 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:15.937507    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q"
Sep 19 04:31:20.642209 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:20.642173    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:31:34.646912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:34.646874    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:31:49.252194 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.252161    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"]
Sep 19 04:31:49.256497 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.256482    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.258787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.258768    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 19 04:31:49.268448 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.268428    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"]
Sep 19 04:31:49.374709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.374868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948e9a6-49e4-4a0a-8447-b857525d01cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.374868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374779    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.374868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.374868 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374858    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.375001 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.374875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5t6\" (UniqueName: \"kubernetes.io/projected/5948e9a6-49e4-4a0a-8447-b857525d01cf-kube-api-access-jq5t6\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475398 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475368    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475415    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948e9a6-49e4-4a0a-8447-b857525d01cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475432    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475547    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5t6\" (UniqueName: \"kubernetes.io/projected/5948e9a6-49e4-4a0a-8447-b857525d01cf-kube-api-access-jq5t6\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475835 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475806    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-home\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475896 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.475978 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.475952    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-model-cache\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.477964 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.477940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5948e9a6-49e4-4a0a-8447-b857525d01cf-dshm\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.478061 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.478037    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5948e9a6-49e4-4a0a-8447-b857525d01cf-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.484538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.484509    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5t6\" (UniqueName: \"kubernetes.io/projected/5948e9a6-49e4-4a0a-8447-b857525d01cf-kube-api-access-jq5t6\") pod \"e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n\" (UID: \"5948e9a6-49e4-4a0a-8447-b857525d01cf\") " pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.566662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.566634    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:49.838339 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:49.838311    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"]
Sep 19 04:31:49.840321 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:31:49.840291    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5948e9a6_49e4_4a0a_8447_b857525d01cf.slice/crio-5755b84ebdb801a32675e4998837992d141a6917de4be406b728a5209b9e3629 WatchSource:0}: Error finding container 5755b84ebdb801a32675e4998837992d141a6917de4be406b728a5209b9e3629: Status 404 returned error can't find the container with id 5755b84ebdb801a32675e4998837992d141a6917de4be406b728a5209b9e3629
Sep 19 04:31:50.082232 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:50.082186    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n" event={"ID":"5948e9a6-49e4-4a0a-8447-b857525d01cf","Type":"ContainerStarted","Data":"b0f67d5ff5702664611e4c652a9458d39fb8ce58c0c020ef773158b844a1d48c"}
Sep 19 04:31:50.082401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:50.082243    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n" event={"ID":"5948e9a6-49e4-4a0a-8447-b857525d01cf","Type":"ContainerStarted","Data":"5755b84ebdb801a32675e4998837992d141a6917de4be406b728a5209b9e3629"}
Sep 19 04:31:50.101609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:50.101516    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n" podStartSLOduration=0.936622012 podStartE2EDuration="1.101499912s" totalImagesPullingTime="164.8779ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:31:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:31:50.099809993 +0000 UTC m=+1098.633791433" watchObservedRunningTime="2026-09-19 04:31:50.101499912 +0000 UTC m=+1098.635481340"
Sep 19 04:31:50.566919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:50.566887    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:51.157059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:51.157026    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:31:57.934935 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:57.934904    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"]
Sep 19 04:31:57.938493 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:57.938472    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:57.941036 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:57.941012    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 19 04:31:57.952043 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:57.952021    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"]
Sep 19 04:31:58.052968 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.052924    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.053149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.052977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.053149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.053047    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd01453a-f013-4fec-be91-3e4cad5e9112-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.053149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.053082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.053149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.053120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twpm9\" (UniqueName: \"kubernetes.io/projected/dd01453a-f013-4fec-be91-3e4cad5e9112-kube-api-access-twpm9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.053374 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.053170    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154614    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd01453a-f013-4fec-be91-3e4cad5e9112-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twpm9\" (UniqueName: \"kubernetes.io/projected/dd01453a-f013-4fec-be91-3e4cad5e9112-kube-api-access-twpm9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.154845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.154710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.155071 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.155042    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.155124 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.155068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.155124 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.155085    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.157169 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.157148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd01453a-f013-4fec-be91-3e4cad5e9112-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.157472 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.157451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd01453a-f013-4fec-be91-3e4cad5e9112-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.164299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.164262    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twpm9\" (UniqueName: \"kubernetes.io/projected/dd01453a-f013-4fec-be91-3e4cad5e9112-kube-api-access-twpm9\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj\" (UID: \"dd01453a-f013-4fec-be91-3e4cad5e9112\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.249343 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.249228    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:58.520086 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:58.520058    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"]
Sep 19 04:31:58.522026 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:31:58.522003    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd01453a_f013_4fec_be91_3e4cad5e9112.slice/crio-684d8c9cd2e28c708e1e534c10c791b7bd96aaf772b5075b9e9e930779f7e9db WatchSource:0}: Error finding container 684d8c9cd2e28c708e1e534c10c791b7bd96aaf772b5075b9e9e930779f7e9db: Status 404 returned error can't find the container with id 684d8c9cd2e28c708e1e534c10c791b7bd96aaf772b5075b9e9e930779f7e9db
Sep 19 04:31:59.124749 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.124705    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj" event={"ID":"dd01453a-f013-4fec-be91-3e4cad5e9112","Type":"ContainerStarted","Data":"a726686b888b3ae28a42b83f211e77d9a41cbda8e390147da877411a3f0625d8"}
Sep 19 04:31:59.125119 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.124803    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj" event={"ID":"dd01453a-f013-4fec-be91-3e4cad5e9112","Type":"ContainerStarted","Data":"684d8c9cd2e28c708e1e534c10c791b7bd96aaf772b5075b9e9e930779f7e9db"}
Sep 19 04:31:59.153881 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.153811    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj" podStartSLOduration=1.997819306 podStartE2EDuration="2.153789929s" totalImagesPullingTime="155.970623ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:31:59.148412399 +0000 UTC m=+1107.682393838" watchObservedRunningTime="2026-09-19 04:31:59.153789929 +0000 UTC m=+1107.687771368"
Sep 19 04:31:59.249648 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.249614    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:31:59.567289 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.567254    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:31:59.579657 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:31:59.579636    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:32:00.140391 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:00.140356    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n"
Sep 19 04:32:00.258145 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:00.258112    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:32:08.159426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:08.159387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:32:08.250079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:08.250047    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:32:08.262513 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:08.262488    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:32:09.182185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:09.182155    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj"
Sep 19 04:32:41.967237 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:32:41.967205    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:33:31.927465 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:31.927435    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:33:31.930002 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:31.927641    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:33:47.237981 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.237948    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:33:47.241339 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.241319    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.249820 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.249799    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-bcbdad-openshift-default-dockercfg-lbml7\""
Sep 19 04:33:47.269080 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.269059    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:33:47.306062 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306062 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306062    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306084    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306106    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306172    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306260    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfknz\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306571 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306327    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306571 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.306571 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.306367    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407581    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407639    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407657    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407676    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfknz\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407767    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.407861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.407842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.408207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.408105    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.408207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.408143    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.408207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.408189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.408343 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.408236    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.408656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.408640    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.410199 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.410177    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.410507 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.410489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.430293 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.430251    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfknz\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.430716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.430695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token\") pod \"e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") " pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.551761 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.551731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:33:47.850632 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:47.850543    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:33:47.855937 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:33:47.855907    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca26fbb1_b772_4927_b171_662527c7cb0d.slice/crio-23b7e3906002abed131393fc08841e52713a71c8a8049dc3debce0d0dea53248 WatchSource:0}: Error finding container 23b7e3906002abed131393fc08841e52713a71c8a8049dc3debce0d0dea53248: Status 404 returned error can't find the container with id 23b7e3906002abed131393fc08841e52713a71c8a8049dc3debce0d0dea53248
Sep 19 04:33:48.647481 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:48.647444    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerStarted","Data":"23b7e3906002abed131393fc08841e52713a71c8a8049dc3debce0d0dea53248"}
Sep 19 04:33:52.804468 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:52.804432    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:33:53.991759 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:53.991727    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:33:53.996708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:53.996686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:53.999608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:53.999581    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-d0f416-serving-cert\""
Sep 19 04:33:54.000503 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.000476    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7pswq\""
Sep 19 04:33:54.000642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.000543    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 04:33:54.014638 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.014611    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:33:54.071076 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.071044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9xn9\" (UniqueName: \"kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.071219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.071100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.071386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.071361    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.071522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.071483    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.172746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.172708    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9xn9\" (UniqueName: \"kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.172994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.172975    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.173150 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.173136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.173252 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.173239    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.174126 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.174102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.174989 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:33:54.174971    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-serving-cert: secret "maas-api-e2e-worker-w4-d0f416-serving-cert" not found
Sep 19 04:33:54.175162 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:33:54.175150    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls podName:32b721f4-4c1c-4bcf-bbe5-997fff6d9e88 nodeName:}" failed. No retries permitted until 2026-09-19 04:33:54.675127607 +0000 UTC m=+1223.209109027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls") pod "maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" (UID: "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88") : secret "maas-api-e2e-worker-w4-d0f416-serving-cert" not found
Sep 19 04:33:54.178592 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.178566    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.185912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.185881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9xn9\" (UniqueName: \"kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.678459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.678426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.681058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.681039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") pod \"maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:54.918233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:54.918197    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:55.193875 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:55.193853    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:33:55.195923 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:33:55.195895    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32b721f4_4c1c_4bcf_bbe5_997fff6d9e88.slice/crio-f752f84e19039bff92ba3e70e8a8e72f2441a580b17bffa3e53b68d46a72a3e2 WatchSource:0}: Error finding container f752f84e19039bff92ba3e70e8a8e72f2441a580b17bffa3e53b68d46a72a3e2: Status 404 returned error can't find the container with id f752f84e19039bff92ba3e70e8a8e72f2441a580b17bffa3e53b68d46a72a3e2
Sep 19 04:33:55.682984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:55.682955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" event={"ID":"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88","Type":"ContainerStarted","Data":"18f72cfda832a71357229c67ffe5b58b52b15644ba84e5cbfe3698f9d38478f3"}
Sep 19 04:33:55.683132 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:55.683002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" event={"ID":"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88","Type":"ContainerStarted","Data":"f752f84e19039bff92ba3e70e8a8e72f2441a580b17bffa3e53b68d46a72a3e2"}
Sep 19 04:33:55.683132 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:55.683058    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:33:55.722368 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:55.722324    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" podStartSLOduration=2.365170709 podStartE2EDuration="2.722310111s" totalImagesPullingTime="357.139402ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:33:55.722178427 +0000 UTC m=+1224.256159864" watchObservedRunningTime="2026-09-19 04:33:55.722310111 +0000 UTC m=+1224.256291549"
Sep 19 04:33:58.246191 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.246158    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:33:58.249827 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.249807    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.253516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.253492    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e8aaa06f-openshift-default-dockercfg-mqvxg\""
Sep 19 04:33:58.271528 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.271504    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:33:58.315450 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315490    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315578    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315605    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315620    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315637    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315987 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315724    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.315987 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.315770    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w9tn\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416378 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416343    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416396    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w9tn\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416463    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416543    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416789 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416593    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416789 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416789 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416640    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.416789 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.417009 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.416906    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.417255 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.417233    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.417398 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.417381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.417573 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.417544    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.417788 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.417762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.419323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.419303    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.419478 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.419461    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.431807 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.431788    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w9tn\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.432611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.432595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token\") pod \"e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") " pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.560052 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.560017    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:33:58.838727 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:58.838702    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:33:58.840937 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:33:58.840914    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c5aa406_dcd7_42e1_99ef_88bd9b7abd9a.slice/crio-92667be7c63d1b192ba30596d4998c0a50e022896ba644dc02755cf5f474b237 WatchSource:0}: Error finding container 92667be7c63d1b192ba30596d4998c0a50e022896ba644dc02755cf5f474b237: Status 404 returned error can't find the container with id 92667be7c63d1b192ba30596d4998c0a50e022896ba644dc02755cf5f474b237
Sep 19 04:33:59.704853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:33:59.704817    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerStarted","Data":"92667be7c63d1b192ba30596d4998c0a50e022896ba644dc02755cf5f474b237"}
Sep 19 04:34:01.516510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.516466    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.516816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.516571    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.516816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.516599    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.522489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.522465    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.522541 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.522521    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.522573 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.522549    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:01.696217 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.696183    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:34:01.725665 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.725626    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerStarted","Data":"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"}
Sep 19 04:34:01.727585 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.727548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerStarted","Data":"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"}
Sep 19 04:34:01.752460 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.752367    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podStartSLOduration=1.079228288 podStartE2EDuration="3.752347275s" totalImagesPullingTime="2.673118987s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:01.751189884 +0000 UTC m=+1230.285171360" watchObservedRunningTime="2026-09-19 04:34:01.752347275 +0000 UTC m=+1230.286328709"
Sep 19 04:34:01.778044 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:01.777945    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podStartSLOduration=1.113748577 podStartE2EDuration="14.777928056s" totalImagesPullingTime="13.664179479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:33:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:01.775442817 +0000 UTC m=+1230.309424255" watchObservedRunningTime="2026-09-19 04:34:01.777928056 +0000 UTC m=+1230.311909498"
Sep 19 04:34:02.552777 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.552737    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:02.553307 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.552942    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:02.560221 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.560187    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:02.560644 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.560619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:02.567545 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.567520    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:02.732561 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.732516    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:02.733393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.733372    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:02.733505 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:02.733429    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:08.098186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.098152    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:08.101857 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.101840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.104414 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.104393    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-e8aaa06f-serving-cert\""
Sep 19 04:34:08.113346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.113327    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:08.213441 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.213400    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98fd9\" (UniqueName: \"kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.213605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.213474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.213605 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.213534    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.213729 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.213643    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.314662 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.314628    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.314818 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.314667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98fd9\" (UniqueName: \"kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.314818 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.314697    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.314818 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.314750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.314818 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:08.314765    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-serving-cert: secret "maas-api-e2e-ait-e8aaa06f-serving-cert" not found
Sep 19 04:34:08.314988 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:08.314835    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls podName:7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78 nodeName:}" failed. No retries permitted until 2026-09-19 04:34:08.814819516 +0000 UTC m=+1237.348800932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls") pod "maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" (UID: "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78") : secret "maas-api-e2e-ait-e8aaa06f-serving-cert" not found
Sep 19 04:34:08.315433 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.315417    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.317133 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.317106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.326643 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.326615    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98fd9\" (UniqueName: \"kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.818776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.818721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:08.821631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:08.821606    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") pod \"maas-api-e2e-ait-e8aaa06f-94b655694-2ps84\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:09.013108 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.013071    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:09.289780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.289745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:09.291432 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:09.291406    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d4b1a6f_ab8a_4d19_83d9_185f7dd8ac78.slice/crio-3ea71be39bf5b8a1befafcb1cbb0e6cad4834a9ce8e8292c7673c0b47bd54404 WatchSource:0}: Error finding container 3ea71be39bf5b8a1befafcb1cbb0e6cad4834a9ce8e8292c7673c0b47bd54404: Status 404 returned error can't find the container with id 3ea71be39bf5b8a1befafcb1cbb0e6cad4834a9ce8e8292c7673c0b47bd54404
Sep 19 04:34:09.769813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.769777    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" event={"ID":"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78","Type":"ContainerStarted","Data":"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"}
Sep 19 04:34:09.769984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.769852    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" event={"ID":"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78","Type":"ContainerStarted","Data":"3ea71be39bf5b8a1befafcb1cbb0e6cad4834a9ce8e8292c7673c0b47bd54404"}
Sep 19 04:34:09.769984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.769922    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:09.801923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:09.801872    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" podStartSLOduration=1.471426344 podStartE2EDuration="1.801856935s" totalImagesPullingTime="330.430591ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:09.799993407 +0000 UTC m=+1238.333974847" watchObservedRunningTime="2026-09-19 04:34:09.801856935 +0000 UTC m=+1238.335838373"
Sep 19 04:34:10.874204 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:10.874171    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:34:10.877776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:10.877759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:10.885426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:10.885403    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-bcbdad-serving-cert\""
Sep 19 04:34:10.902510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:10.902486    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:34:11.040107 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.040067    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.040328 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.040120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.040328 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.040218    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h888\" (UniqueName: \"kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.040458 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.040342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.141231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.141157    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h888\" (UniqueName: \"kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.141231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.141222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.141426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.141250    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.141426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.141287    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.142022 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.141956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.143943 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.143920    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.143943 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.143927    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.152040 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.152021    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h888\" (UniqueName: \"kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888\") pod \"maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.187084 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.187062    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:11.462641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.462615    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:34:11.463892 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:11.463861    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa70044e_19ed_4d1d_8347_c529d059ae9b.slice/crio-7f83a0bf21c423e39bde75141e78d537889cb03acc66047b8ccccd590d3b8bdd WatchSource:0}: Error finding container 7f83a0bf21c423e39bde75141e78d537889cb03acc66047b8ccccd590d3b8bdd: Status 404 returned error can't find the container with id 7f83a0bf21c423e39bde75141e78d537889cb03acc66047b8ccccd590d3b8bdd
Sep 19 04:34:11.783400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.783308    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" event={"ID":"aa70044e-19ed-4d1d-8347-c529d059ae9b","Type":"ContainerStarted","Data":"7f83a0bf21c423e39bde75141e78d537889cb03acc66047b8ccccd590d3b8bdd"}
Sep 19 04:34:11.887059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.887017    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:34:11.892239 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.892207    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:11.895135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.895111    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-bcbdad-dockercfg-9hvvj\""
Sep 19 04:34:11.897441 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.897415    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-bcbdad\""
Sep 19 04:34:11.906192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:11.906167    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:34:12.053216 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.053180    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrvlt\" (UniqueName: \"kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.053428 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.053227    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.153978 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.153939    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrvlt\" (UniqueName: \"kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.154186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.153992    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.154681 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.154661    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.162171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.162148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrvlt\" (UniqueName: \"kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt\") pod \"payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.206331 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.206301    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:12.489459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.489432    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:34:12.493536 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:12.493350    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8aa4bb_ec5c_4880_9409_3fc308201d20.slice/crio-a1d33a1c26c2f764b77f7da8be6709654ac39b854e85524118fde790106ea050 WatchSource:0}: Error finding container a1d33a1c26c2f764b77f7da8be6709654ac39b854e85524118fde790106ea050: Status 404 returned error can't find the container with id a1d33a1c26c2f764b77f7da8be6709654ac39b854e85524118fde790106ea050
Sep 19 04:34:12.790212 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.790177    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" event={"ID":"aa70044e-19ed-4d1d-8347-c529d059ae9b","Type":"ContainerStarted","Data":"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"}
Sep 19 04:34:12.790401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.790241    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:12.791427 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:12.791408    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" event={"ID":"6e8aa4bb-ec5c-4880-9409-3fc308201d20","Type":"ContainerStarted","Data":"a1d33a1c26c2f764b77f7da8be6709654ac39b854e85524118fde790106ea050"}
Sep 19 04:34:14.805117 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:14.805085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" event={"ID":"6e8aa4bb-ec5c-4880-9409-3fc308201d20","Type":"ContainerStarted","Data":"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"}
Sep 19 04:34:14.805562 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:14.805200    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:14.830400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:14.830354    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" podStartSLOduration=4.086459649 podStartE2EDuration="4.830337197s" totalImagesPullingTime="743.877548ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:12.825976721 +0000 UTC m=+1241.359958158" watchObservedRunningTime="2026-09-19 04:34:14.830337197 +0000 UTC m=+1243.364318634"
Sep 19 04:34:14.831033 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:14.831010    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" podStartSLOduration=1.698029251 podStartE2EDuration="3.831002481s" totalImagesPullingTime="2.13297323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:14.828672868 +0000 UTC m=+1243.362654306" watchObservedRunningTime="2026-09-19 04:34:14.831002481 +0000 UTC m=+1243.364983919"
Sep 19 04:34:15.780677 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:15.780650    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:17.384160 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:17.384124    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:34:18.804421 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:18.804338    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:34:25.812823 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:25.812791    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:34:29.885171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.885138    2584 generic.go:356] "Generic (PLEG): container finished" podID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerID="443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec" exitCode=0
Sep 19 04:34:29.885628 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.885212    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerDied","Data":"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"}
Sep 19 04:34:29.885704 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.885645    2584 scope.go:117] "RemoveContainer" containerID="443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"
Sep 19 04:34:29.886767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.886741    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:29.886822 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.886805    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:29.886854 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:29.886836    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:30.892471 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:30.892438    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerStarted","Data":"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"}
Sep 19 04:34:31.560692 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:31.560661    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:31.561962 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:31.561931    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:31.562099 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:31.561993    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:32.495453 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.495415    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:34:32.505490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.505470    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.508921 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.508900    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-6b1935-serving-cert\""
Sep 19 04:34:32.515487 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.515425    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:34:32.560511 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.560485    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:32.560653 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.560531    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:32.571358 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.571335    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdtm8\" (UniqueName: \"kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.571611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.571377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.571611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.571518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.571611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.571596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.673143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.673110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdtm8\" (UniqueName: \"kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.673143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.673150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.673443 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.673185    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.673443 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.673318    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.674125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.674080    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.676091 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.676064    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.676185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.676064    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.685333 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.685268    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdtm8\" (UniqueName: \"kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8\") pod \"maas-api-e2e-inf-b-6b1935-57d746f95b-brggs\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:32.733046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.733014    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:32.816677 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:32.816632    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:33.109352 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.101232    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:34:33.114092 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:33.114063    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c11c209_80f7_463e_b73f_d32b9126cf00.slice/crio-c4851e139c19eed36f4fd68f30111dd628ba04776edf811c862a4c96b23e0858 WatchSource:0}: Error finding container c4851e139c19eed36f4fd68f30111dd628ba04776edf811c862a4c96b23e0858: Status 404 returned error can't find the container with id c4851e139c19eed36f4fd68f30111dd628ba04776edf811c862a4c96b23e0858
Sep 19 04:34:33.115999 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.115978    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:34:33.560621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.560589    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:33.561050 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.560656    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:33.919127 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.919091    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" event={"ID":"3c11c209-80f7-463e-b73f-d32b9126cf00","Type":"ContainerStarted","Data":"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"}
Sep 19 04:34:33.919338 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.919150    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:33.919338 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.919174    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" event={"ID":"3c11c209-80f7-463e-b73f-d32b9126cf00","Type":"ContainerStarted","Data":"c4851e139c19eed36f4fd68f30111dd628ba04776edf811c862a4c96b23e0858"}
Sep 19 04:34:33.956130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:33.956083    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" podStartSLOduration=1.584889041 podStartE2EDuration="1.95606735s" totalImagesPullingTime="371.178309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:33.953776296 +0000 UTC m=+1262.487757733" watchObservedRunningTime="2026-09-19 04:34:33.95606735 +0000 UTC m=+1262.490048789"
Sep 19 04:34:34.561201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:34.561168    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:34.561607 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:34.561221    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:35.561268 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:35.561232    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:35.561719 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:35.561305    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:36.560790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:36.560742    2584 patch_prober.go:28] interesting pod/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused" start-of-body=
Sep 19 04:34:36.560968 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:36.560832    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.38:15021/healthz/ready\": dial tcp 10.132.0.38:15021: connect: connection refused"
Sep 19 04:34:37.564906 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:37.564876    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:37.565861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:37.565841    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:39.390392 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.387637    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:39.391178 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.391142    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" podUID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" containerName="maas-api" containerID="cri-o://f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e" gracePeriod=30
Sep 19 04:34:39.666443 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.666415    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:39.765202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.765174    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs\") pod \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") "
Sep 19 04:34:39.765386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.765255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-98fd9\" (UniqueName: \"kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9\") pod \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") "
Sep 19 04:34:39.765386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.765330    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca\") pod \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") "
Sep 19 04:34:39.765386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.765355    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") pod \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\" (UID: \"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78\") "
Sep 19 04:34:39.765671 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.765643    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" (UID: "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:34:39.767521 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.767496    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" (UID: "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:34:39.767673 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.767573    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9" (OuterVolumeSpecName: "kube-api-access-98fd9") pod "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" (UID: "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78"). InnerVolumeSpecName "kube-api-access-98fd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:34:39.767861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.767845    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" (UID: "7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:34:39.866626 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.866588    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.866626 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.866628    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-98fd9\" (UniqueName: \"kubernetes.io/projected/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-kube-api-access-98fd9\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.866815 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.866643    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.866815 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.866657    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:39.877936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.877906    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:34:39.878098 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.878079    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy" containerID="cri-o://31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696" gracePeriod=30
Sep 19 04:34:39.930170 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.930089    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:34:39.962802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.960956    2584 generic.go:356] "Generic (PLEG): container finished" podID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" containerID="f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e" exitCode=0
Sep 19 04:34:39.962802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.960998    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" event={"ID":"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78","Type":"ContainerDied","Data":"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"}
Sep 19 04:34:39.962802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.961074    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"
Sep 19 04:34:39.962802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.962719    2584 scope.go:117] "RemoveContainer" containerID="f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"
Sep 19 04:34:39.972659 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.972627    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84" event={"ID":"7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78","Type":"ContainerDied","Data":"3ea71be39bf5b8a1befafcb1cbb0e6cad4834a9ce8e8292c7673c0b47bd54404"}
Sep 19 04:34:39.983554 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.982490    2584 scope.go:117] "RemoveContainer" containerID="f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"
Sep 19 04:34:39.983554 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:39.982878    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e\": container with ID starting with f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e not found: ID does not exist" containerID="f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"
Sep 19 04:34:39.983554 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:39.982915    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e"} err="failed to get container status \"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e\": rpc error: code = NotFound desc = could not find container \"f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e\": container with ID starting with f847c3d8765dde4940380d4f0cf667c4d3b2af7d03520c7179f8907d8c1b875e not found: ID does not exist"
Sep 19 04:34:40.019488 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.019425    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:40.021606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.021583    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-e8aaa06f-94b655694-2ps84"]
Sep 19 04:34:40.808428 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.808402    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:34:40.808863 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.808835    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" containerName="maas-api"
Sep 19 04:34:40.808863 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.808846    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" containerName="maas-api"
Sep 19 04:34:40.808984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.808931    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" containerName="maas-api"
Sep 19 04:34:40.813292 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.813249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.815800 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.815778    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-1b8ef317-gw-openshift-default-dockercfg-pp6xl\""
Sep 19 04:34:40.828520 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.828495    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:34:40.979396 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979363    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979468    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979513    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979800 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979800 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979800 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979682    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:40.979800 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:40.979734    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.080790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.080790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080751    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.080790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080843    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080869    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.080885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081157    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081176    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081247    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081455 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081297    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081455 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.081579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.081559    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.082064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.082040    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.083622 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.083599    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.083851 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.083835    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.091696 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.091672    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.091773 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.091726    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token\") pod \"e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") " pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.126845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.126821    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:41.419077 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.419035    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:34:41.419944 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:41.419908    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55240fd8_86d1_4178_bc54_65087e4610c8.slice/crio-bd5471673142fc2482de9ca3a46fa178b81b41034d2382962198186aa3ec5e95 WatchSource:0}: Error finding container bd5471673142fc2482de9ca3a46fa178b81b41034d2382962198186aa3ec5e95: Status 404 returned error can't find the container with id bd5471673142fc2482de9ca3a46fa178b81b41034d2382962198186aa3ec5e95
Sep 19 04:34:41.422951 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.422917    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:41.423063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.422985    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:41.423063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.423011    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:41.968932 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.968900    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78" path="/var/lib/kubelet/pods/7d4b1a6f-ab8a-4d19-83d9-185f7dd8ac78/volumes"
Sep 19 04:34:41.975879 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.975846    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerStarted","Data":"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"}
Sep 19 04:34:41.976055 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:41.975897    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerStarted","Data":"bd5471673142fc2482de9ca3a46fa178b81b41034d2382962198186aa3ec5e95"}
Sep 19 04:34:42.001215 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:42.001149    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podStartSLOduration=2.001125491 podStartE2EDuration="2.001125491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:41.997819439 +0000 UTC m=+1270.531800881" watchObservedRunningTime="2026-09-19 04:34:42.001125491 +0000 UTC m=+1270.535106930"
Sep 19 04:34:42.127142 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:42.127086    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:42.133043 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:42.133010    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:42.989213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:42.989174    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:42.990385 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:42.990365    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:34:43.996022 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.995940    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerID="78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135" exitCode=0
Sep 19 04:34:43.996522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.996016    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerDied","Data":"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"}
Sep 19 04:34:43.996669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.996652    2584 scope.go:117] "RemoveContainer" containerID="78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"
Sep 19 04:34:43.997847 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.997817    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:43.997940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.997883    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:43.997940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:43.997916    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:34:45.007552 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.007517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerStarted","Data":"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"}
Sep 19 04:34:45.055178 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.055145    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:34:45.164870 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.164808    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:45.223266 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223239    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223300    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223337    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223381    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223406    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w9tn\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223509    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223535    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data\") pod \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\" (UID: \"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a\") "
Sep 19 04:34:45.223738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223554    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:34:45.223738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223633    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:34:45.224006 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223773    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:34:45.224006 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.223860    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:34:45.224299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.224005    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.224299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.224024    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.224299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.224037    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.224299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.224054    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.224299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.224069    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:34:45.225858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.225831    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:34:45.225858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.225832    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:34:45.226058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.226038    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:34:45.226400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.226383    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn" (OuterVolumeSpecName: "kube-api-access-7w9tn") pod "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" (UID: "2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a"). InnerVolumeSpecName "kube-api-access-7w9tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:34:45.325041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.325002    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.325041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.325032    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.325041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.325044    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w9tn\" (UniqueName: \"kubernetes.io/projected/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-kube-api-access-7w9tn\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.325322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.325055    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.325322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.325065    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:34:45.552337 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.552305    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:45.553257 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.553226    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 19 04:34:45.553416 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:45.553311    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 19 04:34:46.014303 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.014250    2584 generic.go:356] "Generic (PLEG): container finished" podID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerID="31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696" exitCode=0
Sep 19 04:34:46.014690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.014331    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"
Sep 19 04:34:46.014690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.014341    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerDied","Data":"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"}
Sep 19 04:34:46.014690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.014405    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx" event={"ID":"2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a","Type":"ContainerDied","Data":"92667be7c63d1b192ba30596d4998c0a50e022896ba644dc02755cf5f474b237"}
Sep 19 04:34:46.014690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.014435    2584 scope.go:117] "RemoveContainer" containerID="31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"
Sep 19 04:34:46.024103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.023873    2584 scope.go:117] "RemoveContainer" containerID="443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"
Sep 19 04:34:46.031934 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.031919    2584 scope.go:117] "RemoveContainer" containerID="31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"
Sep 19 04:34:46.032187 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:46.032168    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696\": container with ID starting with 31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696 not found: ID does not exist" containerID="31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"
Sep 19 04:34:46.032258 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.032196    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696"} err="failed to get container status \"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696\": rpc error: code = NotFound desc = could not find container \"31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696\": container with ID starting with 31f564c81c62217517eaaf7ab24341c2ed2d2e897085bc082adec4b0263b7696 not found: ID does not exist"
Sep 19 04:34:46.032258 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.032213    2584 scope.go:117] "RemoveContainer" containerID="443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"
Sep 19 04:34:46.032475 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:46.032459    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec\": container with ID starting with 443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec not found: ID does not exist" containerID="443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"
Sep 19 04:34:46.032516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.032481    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec"} err="failed to get container status \"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec\": rpc error: code = NotFound desc = could not find container \"443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec\": container with ID starting with 443cc710b23f907bcfcde8cfa4a35dd492b0846fe9111b0ee8db64a61c9648ec not found: ID does not exist"
Sep 19 04:34:46.042545 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.042524    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:34:46.047351 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.047330    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e8aaa06f-openshift-default-b95d9b996-w5xpx"]
Sep 19 04:34:46.552735 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.552696    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 19 04:34:46.552920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:46.552761    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 19 04:34:47.104308 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.104136    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:34:47.104860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.104836    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.104948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.104862    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.105006 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.104994    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.109912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.109889    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.116709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.116679    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-1b8ef317-serving-cert\""
Sep 19 04:34:47.127306 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.127259    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:34:47.139582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.139561    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vh82g\" (UniqueName: \"kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.139680 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.139641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.139732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.139688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.139732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.139726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.240954 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.240919    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.241135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.240981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.241135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.241004    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.241135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.241038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vh82g\" (UniqueName: \"kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.241135 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:47.241086    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-serving-cert: secret "maas-api-e2e-migrate-1b8ef317-serving-cert" not found
Sep 19 04:34:47.241332 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:34:47.241159    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls podName:73281233-78b9-4283-94ac-a839a8480a38 nodeName:}" failed. No retries permitted until 2026-09-19 04:34:47.741138967 +0000 UTC m=+1276.275120383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls") pod "maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" (UID: "73281233-78b9-4283-94ac-a839a8480a38") : secret "maas-api-e2e-migrate-1b8ef317-serving-cert" not found
Sep 19 04:34:47.241687 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.241669    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.243632 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.243612    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.257441 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.257412    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vh82g\" (UniqueName: \"kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.552515 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.552480    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 19 04:34:47.552696 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.552554    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 19 04:34:47.732323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.732255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:47.745767 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.745737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.748171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.748149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") pod \"maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:47.794660 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.794625    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:34:47.795584 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.795562    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.795723 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.795711    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.795960 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.795946    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" containerName="istio-proxy"
Sep 19 04:34:47.799858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.799841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.802614 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.802454    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-1b8ef317\""
Sep 19 04:34:47.802797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.802774    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-1b8ef317-dockercfg-c6776\""
Sep 19 04:34:47.806631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.806603    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:34:47.846966 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.846935    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.847095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.847039    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62bjf\" (UniqueName: \"kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.948181 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.948147    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62bjf\" (UniqueName: \"kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.948469 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.948257    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.949003 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.948983    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.957549 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.957524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62bjf\" (UniqueName: \"kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf\") pod \"payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:47.968350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:47.968321    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a" path="/var/lib/kubelet/pods/2c5aa406-dcd7-42e1-99ef-88bd9b7abd9a/volumes"
Sep 19 04:34:48.020270 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.020237    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:48.115961 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.115925    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:48.307861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.307834    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:34:48.310190 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:48.310148    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73281233_78b9_4283_94ac_a839a8480a38.slice/crio-4104469a91b0db59087d46110cff20b27def9bf5c46517787dcb9554d94945a3 WatchSource:0}: Error finding container 4104469a91b0db59087d46110cff20b27def9bf5c46517787dcb9554d94945a3: Status 404 returned error can't find the container with id 4104469a91b0db59087d46110cff20b27def9bf5c46517787dcb9554d94945a3
Sep 19 04:34:48.400087 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.399999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:34:48.405052 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:34:48.405019    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc656b3f2_d9b7_4878_affc_7728d78c3d09.slice/crio-b63fe882dd5d8fb2ba8067fe04fae89ac0230bca6e6dfa068d161c4985fb6e11 WatchSource:0}: Error finding container b63fe882dd5d8fb2ba8067fe04fae89ac0230bca6e6dfa068d161c4985fb6e11: Status 404 returned error can't find the container with id b63fe882dd5d8fb2ba8067fe04fae89ac0230bca6e6dfa068d161c4985fb6e11
Sep 19 04:34:48.552610 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.552573    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 19 04:34:48.552803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:48.552641    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 19 04:34:49.035698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.035595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" event={"ID":"c656b3f2-d9b7-4878-affc-7728d78c3d09","Type":"ContainerStarted","Data":"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"}
Sep 19 04:34:49.035698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.035658    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" event={"ID":"c656b3f2-d9b7-4878-affc-7728d78c3d09","Type":"ContainerStarted","Data":"b63fe882dd5d8fb2ba8067fe04fae89ac0230bca6e6dfa068d161c4985fb6e11"}
Sep 19 04:34:49.035698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.035694    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:34:49.037290 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.037238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" event={"ID":"73281233-78b9-4283-94ac-a839a8480a38","Type":"ContainerStarted","Data":"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"}
Sep 19 04:34:49.037424 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.037328    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:34:49.037424 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.037355    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" event={"ID":"73281233-78b9-4283-94ac-a839a8480a38","Type":"ContainerStarted","Data":"4104469a91b0db59087d46110cff20b27def9bf5c46517787dcb9554d94945a3"}
Sep 19 04:34:49.076972 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.076919    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" podStartSLOduration=2.076901106 podStartE2EDuration="2.076901106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:49.076127189 +0000 UTC m=+1277.610108628" watchObservedRunningTime="2026-09-19 04:34:49.076901106 +0000 UTC m=+1277.610882544"
Sep 19 04:34:49.552335 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.552259    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused" start-of-body=
Sep 19 04:34:49.552784 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:49.552374    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.36:15021/healthz/ready\": dial tcp 10.132.0.36:15021: connect: connection refused"
Sep 19 04:34:50.556476 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:50.556441    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:50.558085 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:50.558067    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:34:50.613058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:50.613011    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" podStartSLOduration=3.308286486 podStartE2EDuration="3.612997376s" totalImagesPullingTime="304.71089ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:34:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:34:49.102546854 +0000 UTC m=+1277.636528283" watchObservedRunningTime="2026-09-19 04:34:50.612997376 +0000 UTC m=+1279.146978814"
Sep 19 04:34:55.049318 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:34:55.049291    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:35:00.046327 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:00.046288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:35:07.645118 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:07.645079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:35:09.166354 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.166324    2584 generic.go:356] "Generic (PLEG): container finished" podID="55240fd8-86d1-4178-bc54-65087e4610c8" containerID="2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39" exitCode=0
Sep 19 04:35:09.166801 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.166403    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerDied","Data":"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"}
Sep 19 04:35:09.166858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.166832    2584 scope.go:117] "RemoveContainer" containerID="2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"
Sep 19 04:35:09.167923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.167899    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:09.167985 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.167961    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:09.168020 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:09.167988    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:10.174049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:10.174012    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerStarted","Data":"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"}
Sep 19 04:35:11.126942 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:11.126911    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:11.128218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:11.128189    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:11.128349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:11.128287    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 19 04:35:12.127845 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:12.127812    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:12.128218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:12.127899    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 19 04:35:12.989452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:12.989404    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:13.127799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:13.127766    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:13.127958 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:13.127821    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 19 04:35:14.127687 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:14.127654    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:14.127867 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:14.127718    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 19 04:35:15.127728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:15.127696    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body=
Sep 19 04:35:15.128179 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:15.128148    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused"
Sep 19 04:35:16.132216 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:16.132187    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:16.133126 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:16.133108    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:25.748505 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:25.748471    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:35:25.748865 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:25.748709    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" podUID="73281233-78b9-4283-94ac-a839a8480a38" containerName="maas-api" containerID="cri-o://9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258" gracePeriod=30
Sep 19 04:35:25.839053 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:25.839017    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:35:25.839233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:25.839214    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" podUID="c656b3f2-d9b7-4878-affc-7728d78c3d09" containerName="payload-pre-processing" containerID="cri-o://6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56" gracePeriod=30
Sep 19 04:35:26.102504 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.102439    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:35:26.116808 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.116780    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca\") pod \"73281233-78b9-4283-94ac-a839a8480a38\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") "
Sep 19 04:35:26.116808 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.116831    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vh82g\" (UniqueName: \"kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g\") pod \"73281233-78b9-4283-94ac-a839a8480a38\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") "
Sep 19 04:35:26.120222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.116881    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs\") pod \"73281233-78b9-4283-94ac-a839a8480a38\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") "
Sep 19 04:35:26.120222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.116958    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") pod \"73281233-78b9-4283-94ac-a839a8480a38\" (UID: \"73281233-78b9-4283-94ac-a839a8480a38\") "
Sep 19 04:35:26.120222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.117237    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "73281233-78b9-4283-94ac-a839a8480a38" (UID: "73281233-78b9-4283-94ac-a839a8480a38"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:35:26.120222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.117429    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/73281233-78b9-4283-94ac-a839a8480a38-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.121564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.121401    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g" (OuterVolumeSpecName: "kube-api-access-vh82g") pod "73281233-78b9-4283-94ac-a839a8480a38" (UID: "73281233-78b9-4283-94ac-a839a8480a38"). InnerVolumeSpecName "kube-api-access-vh82g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:35:26.121564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.121514    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "73281233-78b9-4283-94ac-a839a8480a38" (UID: "73281233-78b9-4283-94ac-a839a8480a38"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:35:26.123732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.123708    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "73281233-78b9-4283-94ac-a839a8480a38" (UID: "73281233-78b9-4283-94ac-a839a8480a38"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:35:26.146940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.146893    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:35:26.179044 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.179011    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:35:26.179346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.179260    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" containerID="cri-o://a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3" gracePeriod=30
Sep 19 04:35:26.217948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.217918    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62bjf\" (UniqueName: \"kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf\") pod \"c656b3f2-d9b7-4878-affc-7728d78c3d09\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") "
Sep 19 04:35:26.217948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.217957    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume\") pod \"c656b3f2-d9b7-4878-affc-7728d78c3d09\" (UID: \"c656b3f2-d9b7-4878-affc-7728d78c3d09\") "
Sep 19 04:35:26.218229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.218188    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vh82g\" (UniqueName: \"kubernetes.io/projected/73281233-78b9-4283-94ac-a839a8480a38-kube-api-access-vh82g\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.218229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.218199    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.218229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.218208    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/73281233-78b9-4283-94ac-a839a8480a38-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.218451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.218369    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c656b3f2-d9b7-4878-affc-7728d78c3d09" (UID: "c656b3f2-d9b7-4878-affc-7728d78c3d09"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:35:26.220144 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.220119    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf" (OuterVolumeSpecName: "kube-api-access-62bjf") pod "c656b3f2-d9b7-4878-affc-7728d78c3d09" (UID: "c656b3f2-d9b7-4878-affc-7728d78c3d09"). InnerVolumeSpecName "kube-api-access-62bjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:35:26.285821 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.285729    2584 generic.go:356] "Generic (PLEG): container finished" podID="c656b3f2-d9b7-4878-affc-7728d78c3d09" containerID="6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56" exitCode=0
Sep 19 04:35:26.285821 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.285775    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"
Sep 19 04:35:26.286037 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.285811    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" event={"ID":"c656b3f2-d9b7-4878-affc-7728d78c3d09","Type":"ContainerDied","Data":"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"}
Sep 19 04:35:26.286037 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.285874    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659" event={"ID":"c656b3f2-d9b7-4878-affc-7728d78c3d09","Type":"ContainerDied","Data":"b63fe882dd5d8fb2ba8067fe04fae89ac0230bca6e6dfa068d161c4985fb6e11"}
Sep 19 04:35:26.286037 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.285906    2584 scope.go:117] "RemoveContainer" containerID="6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"
Sep 19 04:35:26.288077 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.288023    2584 generic.go:356] "Generic (PLEG): container finished" podID="73281233-78b9-4283-94ac-a839a8480a38" containerID="9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258" exitCode=0
Sep 19 04:35:26.288224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.288144    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" event={"ID":"73281233-78b9-4283-94ac-a839a8480a38","Type":"ContainerDied","Data":"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"}
Sep 19 04:35:26.288224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.288184    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6" event={"ID":"73281233-78b9-4283-94ac-a839a8480a38","Type":"ContainerDied","Data":"4104469a91b0db59087d46110cff20b27def9bf5c46517787dcb9554d94945a3"}
Sep 19 04:35:26.288371 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.288245    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"
Sep 19 04:35:26.302350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.302330    2584 scope.go:117] "RemoveContainer" containerID="6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"
Sep 19 04:35:26.303038 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:26.302700    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56\": container with ID starting with 6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56 not found: ID does not exist" containerID="6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"
Sep 19 04:35:26.303038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.302735    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56"} err="failed to get container status \"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56\": rpc error: code = NotFound desc = could not find container \"6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56\": container with ID starting with 6f467ec01100e5c137bebc42f81190da9a0d2a97a2f5e530d2dcf920e4c52f56 not found: ID does not exist"
Sep 19 04:35:26.303038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.302774    2584 scope.go:117] "RemoveContainer" containerID="9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"
Sep 19 04:35:26.311597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.311581    2584 scope.go:117] "RemoveContainer" containerID="9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"
Sep 19 04:35:26.311857 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:26.311842    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258\": container with ID starting with 9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258 not found: ID does not exist" containerID="9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"
Sep 19 04:35:26.311905 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.311864    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258"} err="failed to get container status \"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258\": rpc error: code = NotFound desc = could not find container \"9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258\": container with ID starting with 9ff4e1b3c55f10120c9462f41136d601dcf0975f0abf2d4258a3e085aea63258 not found: ID does not exist"
Sep 19 04:35:26.317872 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.317850    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:35:26.318901 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.318880    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62bjf\" (UniqueName: \"kubernetes.io/projected/c656b3f2-d9b7-4878-affc-7728d78c3d09-kube-api-access-62bjf\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.318957 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.318905    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c656b3f2-d9b7-4878-affc-7728d78c3d09-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:26.323327 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.323306    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-1b8ef317-5798c897d6-ss659"]
Sep 19 04:35:26.333891 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.333869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:35:26.340345 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.340326    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-1b8ef317-6b6d8768-gs7z6"]
Sep 19 04:35:26.950839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.950800    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:35:26.951439 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951408    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73281233-78b9-4283-94ac-a839a8480a38" containerName="maas-api"
Sep 19 04:35:26.951439 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951440    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="73281233-78b9-4283-94ac-a839a8480a38" containerName="maas-api"
Sep 19 04:35:26.951589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951464    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c656b3f2-d9b7-4878-affc-7728d78c3d09" containerName="payload-pre-processing"
Sep 19 04:35:26.951589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951472    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c656b3f2-d9b7-4878-affc-7728d78c3d09" containerName="payload-pre-processing"
Sep 19 04:35:26.951589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951562    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="73281233-78b9-4283-94ac-a839a8480a38" containerName="maas-api"
Sep 19 04:35:26.951589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.951578    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c656b3f2-d9b7-4878-affc-7728d78c3d09" containerName="payload-pre-processing"
Sep 19 04:35:26.956010 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.955991    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:26.958439 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.958417    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-33718462-openshift-default-dockercfg-nt44w\""
Sep 19 04:35:26.970079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:26.970046    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:35:27.025814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.025814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmj2z\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.025814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025784    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.025814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025801    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.026136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.026136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025917    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.026136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025963    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.026136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.025985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.026136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.026027    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127485 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127492    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127508    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127553    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127626    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmj2z\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127665    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127684    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127730    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.127984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.127947    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.135714 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.128803    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.135714 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.129087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.135948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.135876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.136038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.136002    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.136445 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.136406    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.145534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.145514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmj2z\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.148616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.148597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token\") pod \"e2e-ait-33718462-openshift-default-847585db8d-r9htr\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") " pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.265993 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.265964    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:27.546394 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.546365    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:35:27.548153 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:35:27.548122    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e9dcd0_62bb_4e5f_94e7_a49562c3bc57.slice/crio-1969d4fbc2f0a1f24c64fb5f563a477ae4e788df2d0abd1563c30196981aceda WatchSource:0}: Error finding container 1969d4fbc2f0a1f24c64fb5f563a477ae4e788df2d0abd1563c30196981aceda: Status 404 returned error can't find the container with id 1969d4fbc2f0a1f24c64fb5f563a477ae4e788df2d0abd1563c30196981aceda
Sep 19 04:35:27.550529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.550495    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:27.550635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.550570    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:27.550635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.550613    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:35:27.968633 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.968556    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73281233-78b9-4283-94ac-a839a8480a38" path="/var/lib/kubelet/pods/73281233-78b9-4283-94ac-a839a8480a38/volumes"
Sep 19 04:35:27.968973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:27.968924    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c656b3f2-d9b7-4878-affc-7728d78c3d09" path="/var/lib/kubelet/pods/c656b3f2-d9b7-4878-affc-7728d78c3d09/volumes"
Sep 19 04:35:28.302999 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:28.302967    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerStarted","Data":"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"}
Sep 19 04:35:28.303184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:28.303022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerStarted","Data":"1969d4fbc2f0a1f24c64fb5f563a477ae4e788df2d0abd1563c30196981aceda"}
Sep 19 04:35:28.349549 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:28.349494    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" podStartSLOduration=2.349478925 podStartE2EDuration="2.349478925s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:35:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:35:28.346961608 +0000 UTC m=+1316.880943045" watchObservedRunningTime="2026-09-19 04:35:28.349478925 +0000 UTC m=+1316.883460363"
Sep 19 04:35:29.266695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:29.266662    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:29.271996 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:29.271966    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:29.309591 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:29.309556    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:29.310425 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:29.310407    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:35:31.134798 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.134765    2584 patch_prober.go:28] interesting pod/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 04:35:31.135187 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.134829    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:35:31.530653 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.530630    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:31.571950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.571926    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.571972    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572009    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572053    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572073    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572424 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572401    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572574 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572574 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572537    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572574 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572478    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data" (OuterVolumeSpecName: "istio-data") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:35:31.572733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572532    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:35:31.572733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572600    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh\") pod \"55240fd8-86d1-4178-bc54-65087e4610c8\" (UID: \"55240fd8-86d1-4178-bc54-65087e4610c8\") "
Sep 19 04:35:31.572733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572698    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:35:31.572935 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.572908    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:35:31.573196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.573174    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:35:31.573196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.573186    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.573525 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.573209    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.573525 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.573223    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55240fd8-86d1-4178-bc54-65087e4610c8-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.573525 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.573237    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.574938 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.574912    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:35:31.575120 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.575097    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh" (OuterVolumeSpecName: "kube-api-access-ll2hh") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "kube-api-access-ll2hh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:35:31.575166 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.575102    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:35:31.575716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.575695    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token" (OuterVolumeSpecName: "istio-token") pod "55240fd8-86d1-4178-bc54-65087e4610c8" (UID: "55240fd8-86d1-4178-bc54-65087e4610c8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:35:31.653823 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.653747    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:35:31.654229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.654206    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:31.654229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.654228    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:31.654447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.654369    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:31.654447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.654384    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:31.657799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.657780    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.663750 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.663730    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-33718462-serving-cert\""
Sep 19 04:35:31.673433 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673410    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:35:31.673914 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673883    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.673914 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673911    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.674075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673924    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55240fd8-86d1-4178-bc54-65087e4610c8-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.674075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673938    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll2hh\" (UniqueName: \"kubernetes.io/projected/55240fd8-86d1-4178-bc54-65087e4610c8-kube-api-access-ll2hh\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.674075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.673952    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55240fd8-86d1-4178-bc54-65087e4610c8-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:35:31.774715 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.774674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2bk\" (UniqueName: \"kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.774715 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.774716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.774919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.774802    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.774919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.774837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.875866 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.875835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2bk\" (UniqueName: \"kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.875866 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.875870    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.876137 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.875908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.876137 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.875929    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.876663 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.876645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.878448 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.878430    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.879265 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.879247    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-33718462-serving-cert\""
Sep 19 04:35:31.884942 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:31.884922    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2bk\" (UniqueName: \"kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:31.886734 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:31.886717    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-33718462-serving-cert: secret "maas-api-e2e-ait-33718462-serving-cert" not found
Sep 19 04:35:31.886796 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:31.886770    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls podName:f487bee0-d616-4666-8ce1-80a8a9789f0c nodeName:}" failed. No retries permitted until 2026-09-19 04:35:32.386755519 +0000 UTC m=+1320.920736935 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls") pod "maas-api-e2e-ait-33718462-6f56977954-bp6bw" (UID: "f487bee0-d616-4666-8ce1-80a8a9789f0c") : secret "maas-api-e2e-ait-33718462-serving-cert" not found
Sep 19 04:35:32.292839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.292812    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:35:32.293473 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.293458    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:32.293517 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.293477    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" containerName="istio-proxy"
Sep 19 04:35:32.298481 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.298464    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.301157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.301137    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-33718462\""
Sep 19 04:35:32.306288 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.306257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:35:32.327114 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.327088    2584 generic.go:356] "Generic (PLEG): container finished" podID="55240fd8-86d1-4178-bc54-65087e4610c8" containerID="a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3" exitCode=0
Sep 19 04:35:32.327214 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.327143    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"
Sep 19 04:35:32.327214 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.327166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerDied","Data":"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"}
Sep 19 04:35:32.327309 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.327216    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9" event={"ID":"55240fd8-86d1-4178-bc54-65087e4610c8","Type":"ContainerDied","Data":"bd5471673142fc2482de9ca3a46fa178b81b41034d2382962198186aa3ec5e95"}
Sep 19 04:35:32.327309 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.327244    2584 scope.go:117] "RemoveContainer" containerID="a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"
Sep 19 04:35:32.337531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.337509    2584 scope.go:117] "RemoveContainer" containerID="2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"
Sep 19 04:35:32.345983 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.345956    2584 scope.go:117] "RemoveContainer" containerID="a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"
Sep 19 04:35:32.346664 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:32.346636    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3\": container with ID starting with a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3 not found: ID does not exist" containerID="a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"
Sep 19 04:35:32.346816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.346786    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3"} err="failed to get container status \"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3\": rpc error: code = NotFound desc = could not find container \"a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3\": container with ID starting with a337fbbdbd7528bd54c50133f986857898e12edc1c863ceff02649bb744b79b3 not found: ID does not exist"
Sep 19 04:35:32.346816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.346816    2584 scope.go:117] "RemoveContainer" containerID="2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"
Sep 19 04:35:32.347163 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:35:32.347141    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39\": container with ID starting with 2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39 not found: ID does not exist" containerID="2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"
Sep 19 04:35:32.347248 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.347184    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39"} err="failed to get container status \"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39\": rpc error: code = NotFound desc = could not find container \"2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39\": container with ID starting with 2f2b8bfb8d25c1c030aeb91fc212ea21f4f6ceffb2e94e3ff7b1c6441b041c39 not found: ID does not exist"
Sep 19 04:35:32.349934 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.349913    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:35:32.365763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.365736    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-1b8ef317-gw-openshift-default-6795d695bd-f7gq9"]
Sep 19 04:35:32.381900 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.381875    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.382042 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.381941    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jsq2\" (UniqueName: \"kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.482784 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.482750    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.483042 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.482791    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:32.483042 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.482842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jsq2\" (UniqueName: \"kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.483536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.483514    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.485419 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.485399    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") pod \"maas-api-e2e-ait-33718462-6f56977954-bp6bw\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:32.491427 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.491404    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jsq2\" (UniqueName: \"kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2\") pod \"payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.568444 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.568359    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:32.620564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.620531    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:32.846325 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.846298    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:35:32.847838 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:35:32.847812    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf487bee0_d616_4666_8ce1_80a8a9789f0c.slice/crio-e811422c6678347dd27e05e287b007b21ed95f02af6b65aad4160310ff7507dd WatchSource:0}: Error finding container e811422c6678347dd27e05e287b007b21ed95f02af6b65aad4160310ff7507dd: Status 404 returned error can't find the container with id e811422c6678347dd27e05e287b007b21ed95f02af6b65aad4160310ff7507dd
Sep 19 04:35:32.901416 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:32.901394    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:35:32.903342 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:35:32.903317    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8d3a9f3_e379_4285_ae38_10be47de78bf.slice/crio-5f62c91c37b8d249aec536760f7e078057937c3482918dfc3ad135cc59eb572d WatchSource:0}: Error finding container 5f62c91c37b8d249aec536760f7e078057937c3482918dfc3ad135cc59eb572d: Status 404 returned error can't find the container with id 5f62c91c37b8d249aec536760f7e078057937c3482918dfc3ad135cc59eb572d
Sep 19 04:35:33.334990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.334953    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" event={"ID":"a8d3a9f3-e379-4285-ae38-10be47de78bf","Type":"ContainerStarted","Data":"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"}
Sep 19 04:35:33.335429 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.335004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" event={"ID":"a8d3a9f3-e379-4285-ae38-10be47de78bf","Type":"ContainerStarted","Data":"5f62c91c37b8d249aec536760f7e078057937c3482918dfc3ad135cc59eb572d"}
Sep 19 04:35:33.335429 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.335056    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:33.336666 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.336644    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" event={"ID":"f487bee0-d616-4666-8ce1-80a8a9789f0c","Type":"ContainerStarted","Data":"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"}
Sep 19 04:35:33.336782 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.336686    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:33.336782 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.336708    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" event={"ID":"f487bee0-d616-4666-8ce1-80a8a9789f0c","Type":"ContainerStarted","Data":"e811422c6678347dd27e05e287b007b21ed95f02af6b65aad4160310ff7507dd"}
Sep 19 04:35:33.352149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.352107    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" podStartSLOduration=1.3520950919999999 podStartE2EDuration="1.352095092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:35:33.350142462 +0000 UTC m=+1321.884123907" watchObservedRunningTime="2026-09-19 04:35:33.352095092 +0000 UTC m=+1321.886076529"
Sep 19 04:35:33.369386 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.369334    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" podStartSLOduration=2.030769847 podStartE2EDuration="2.369320827s" totalImagesPullingTime="338.55098ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:35:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:35:33.36714079 +0000 UTC m=+1321.901122229" watchObservedRunningTime="2026-09-19 04:35:33.369320827 +0000 UTC m=+1321.903302298"
Sep 19 04:35:33.968323 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:33.968258    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55240fd8-86d1-4178-bc54-65087e4610c8" path="/var/lib/kubelet/pods/55240fd8-86d1-4178-bc54-65087e4610c8/volumes"
Sep 19 04:35:35.439916 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:35.439882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:35:39.347748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:39.347718    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:35:44.344930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:44.344901    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:35:59.562536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:59.561388    2584 patch_prober.go:28] interesting pod/e2e-ait-33718462-openshift-default-847585db8d-r9htr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:45818->10.132.0.46:15021: read: connection reset by peer" start-of-body=
Sep 19 04:35:59.562536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:35:59.561486    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": read tcp 10.132.0.2:45818->10.132.0.46:15021: read: connection reset by peer"
Sep 19 04:36:00.053220 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.053184    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:36:00.482848 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.482752    2584 generic.go:356] "Generic (PLEG): container finished" podID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerID="43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb" exitCode=0
Sep 19 04:36:00.482848 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.482798    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerDied","Data":"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"}
Sep 19 04:36:00.483200 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.483184    2584 scope.go:117] "RemoveContainer" containerID="43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"
Sep 19 04:36:00.484402 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.484371    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:00.484499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.484442    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:00.484499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:00.484482    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:01.494591 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:01.494543    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerStarted","Data":"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"}
Sep 19 04:36:02.266133 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.266103    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:36:02.266351 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.266331    2584 patch_prober.go:28] interesting pod/e2e-ait-33718462-openshift-default-847585db8d-r9htr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 19 04:36:02.266402 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.266383    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 19 04:36:02.511222 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.511186    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:36:02.511975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.511944    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" podUID="f487bee0-d616-4666-8ce1-80a8a9789f0c" containerName="maas-api" containerID="cri-o://390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b" gracePeriod=30
Sep 19 04:36:02.577726 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.577691    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:36:02.577977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.577947    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" podUID="a8d3a9f3-e379-4285-ae38-10be47de78bf" containerName="payload-pre-processing" containerID="cri-o://a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6" gracePeriod=30
Sep 19 04:36:02.873184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.873036    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:36:02.898324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.890591    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca\") pod \"f487bee0-d616-4666-8ce1-80a8a9789f0c\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") "
Sep 19 04:36:02.898324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.890654    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs\") pod \"f487bee0-d616-4666-8ce1-80a8a9789f0c\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") "
Sep 19 04:36:02.898324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.890712    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9k2bk\" (UniqueName: \"kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk\") pod \"f487bee0-d616-4666-8ce1-80a8a9789f0c\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") "
Sep 19 04:36:02.898324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.890740    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") pod \"f487bee0-d616-4666-8ce1-80a8a9789f0c\" (UID: \"f487bee0-d616-4666-8ce1-80a8a9789f0c\") "
Sep 19 04:36:02.910326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.906749    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk" (OuterVolumeSpecName: "kube-api-access-9k2bk") pod "f487bee0-d616-4666-8ce1-80a8a9789f0c" (UID: "f487bee0-d616-4666-8ce1-80a8a9789f0c"). InnerVolumeSpecName "kube-api-access-9k2bk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:02.910326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.907113    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f487bee0-d616-4666-8ce1-80a8a9789f0c" (UID: "f487bee0-d616-4666-8ce1-80a8a9789f0c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:02.910694 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.910415    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f487bee0-d616-4666-8ce1-80a8a9789f0c" (UID: "f487bee0-d616-4666-8ce1-80a8a9789f0c"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:02.914784 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.914744    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f487bee0-d616-4666-8ce1-80a8a9789f0c" (UID: "f487bee0-d616-4666-8ce1-80a8a9789f0c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:02.925213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:02.925189    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.000664    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9jsq2\" (UniqueName: \"kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2\") pod \"a8d3a9f3-e379-4285-ae38-10be47de78bf\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") "
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.000810    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume\") pod \"a8d3a9f3-e379-4285-ae38-10be47de78bf\" (UID: \"a8d3a9f3-e379-4285-ae38-10be47de78bf\") "
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.001119    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9k2bk\" (UniqueName: \"kubernetes.io/projected/f487bee0-d616-4666-8ce1-80a8a9789f0c-kube-api-access-9k2bk\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.001141    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.001156    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f487bee0-d616-4666-8ce1-80a8a9789f0c-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.001304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.001169    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f487bee0-d616-4666-8ce1-80a8a9789f0c-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.001780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.001600    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8d3a9f3-e379-4285-ae38-10be47de78bf" (UID: "a8d3a9f3-e379-4285-ae38-10be47de78bf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:03.005714 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.005677    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2" (OuterVolumeSpecName: "kube-api-access-9jsq2") pod "a8d3a9f3-e379-4285-ae38-10be47de78bf" (UID: "a8d3a9f3-e379-4285-ae38-10be47de78bf"). InnerVolumeSpecName "kube-api-access-9jsq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:03.102201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.102086    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9jsq2\" (UniqueName: \"kubernetes.io/projected/a8d3a9f3-e379-4285-ae38-10be47de78bf-kube-api-access-9jsq2\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.102201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.102135    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8d3a9f3-e379-4285-ae38-10be47de78bf-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:03.266540 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.266506    2584 patch_prober.go:28] interesting pod/e2e-ait-33718462-openshift-default-847585db8d-r9htr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 19 04:36:03.266710 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.266565    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 19 04:36:03.510075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.509978    2584 generic.go:356] "Generic (PLEG): container finished" podID="a8d3a9f3-e379-4285-ae38-10be47de78bf" containerID="a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6" exitCode=0
Sep 19 04:36:03.510075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.510035    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"
Sep 19 04:36:03.510075 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.510057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" event={"ID":"a8d3a9f3-e379-4285-ae38-10be47de78bf","Type":"ContainerDied","Data":"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"}
Sep 19 04:36:03.510412 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.510104    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5" event={"ID":"a8d3a9f3-e379-4285-ae38-10be47de78bf","Type":"ContainerDied","Data":"5f62c91c37b8d249aec536760f7e078057937c3482918dfc3ad135cc59eb572d"}
Sep 19 04:36:03.510412 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.510129    2584 scope.go:117] "RemoveContainer" containerID="a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"
Sep 19 04:36:03.511501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.511478    2584 generic.go:356] "Generic (PLEG): container finished" podID="f487bee0-d616-4666-8ce1-80a8a9789f0c" containerID="390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b" exitCode=0
Sep 19 04:36:03.511858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.511542    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"
Sep 19 04:36:03.511858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.511568    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" event={"ID":"f487bee0-d616-4666-8ce1-80a8a9789f0c","Type":"ContainerDied","Data":"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"}
Sep 19 04:36:03.511858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.511621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw" event={"ID":"f487bee0-d616-4666-8ce1-80a8a9789f0c","Type":"ContainerDied","Data":"e811422c6678347dd27e05e287b007b21ed95f02af6b65aad4160310ff7507dd"}
Sep 19 04:36:03.521090 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.520878    2584 scope.go:117] "RemoveContainer" containerID="a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"
Sep 19 04:36:03.521222 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:03.521196    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6\": container with ID starting with a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6 not found: ID does not exist" containerID="a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"
Sep 19 04:36:03.521300 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.521232    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6"} err="failed to get container status \"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6\": rpc error: code = NotFound desc = could not find container \"a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6\": container with ID starting with a016faf53d9fa35d5e4687523e45a3ffad67ccb5117e75157c95f107a5ad6cb6 not found: ID does not exist"
Sep 19 04:36:03.521300 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.521254    2584 scope.go:117] "RemoveContainer" containerID="390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"
Sep 19 04:36:03.538080 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.538061    2584 scope.go:117] "RemoveContainer" containerID="390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"
Sep 19 04:36:03.538427 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:03.538393    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b\": container with ID starting with 390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b not found: ID does not exist" containerID="390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"
Sep 19 04:36:03.538518 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.538427    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b"} err="failed to get container status \"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b\": rpc error: code = NotFound desc = could not find container \"390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b\": container with ID starting with 390a1f9c9006b3fb58bbb82b729ddb60883b2fdf0fc1a914b34c2e59cb08996b not found: ID does not exist"
Sep 19 04:36:03.541450 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.541430    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:36:03.545639 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.545620    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-33718462-78c68f68cd-8tgq5"]
Sep 19 04:36:03.558855 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.558835    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:36:03.563116 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.563094    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-33718462-6f56977954-bp6bw"]
Sep 19 04:36:03.969251 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.969222    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8d3a9f3-e379-4285-ae38-10be47de78bf" path="/var/lib/kubelet/pods/a8d3a9f3-e379-4285-ae38-10be47de78bf/volumes"
Sep 19 04:36:03.969790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:03.969770    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f487bee0-d616-4666-8ce1-80a8a9789f0c" path="/var/lib/kubelet/pods/f487bee0-d616-4666-8ce1-80a8a9789f0c/volumes"
Sep 19 04:36:04.004444 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.004408    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:36:04.005001 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.004954    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy" containerID="cri-o://e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2" gracePeriod=30
Sep 19 04:36:04.866195 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866165    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:04.866603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866589    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f487bee0-d616-4666-8ce1-80a8a9789f0c" containerName="maas-api"
Sep 19 04:36:04.866603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866601    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f487bee0-d616-4666-8ce1-80a8a9789f0c" containerName="maas-api"
Sep 19 04:36:04.866689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866622    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8d3a9f3-e379-4285-ae38-10be47de78bf" containerName="payload-pre-processing"
Sep 19 04:36:04.866689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866629    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8d3a9f3-e379-4285-ae38-10be47de78bf" containerName="payload-pre-processing"
Sep 19 04:36:04.866689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866688    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8d3a9f3-e379-4285-ae38-10be47de78bf" containerName="payload-pre-processing"
Sep 19 04:36:04.866790 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.866697    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f487bee0-d616-4666-8ce1-80a8a9789f0c" containerName="maas-api"
Sep 19 04:36:04.871408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.871389    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.875264 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.875246    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-2a94cba7-openshift-default-dockercfg-qtbls\""
Sep 19 04:36:04.906162 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.906120    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:04.919440 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919407    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v95jb\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919600 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919471    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919600 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919526    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919600 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919560    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919806 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:04.919840 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:04.919804    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020502 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020474    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020511    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020546    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020616    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020644    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020681    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020738    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v95jb\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.020973 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.020911    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.021225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.021189    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.021328 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.021308    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.021397 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.021323    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.021397 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.021385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.023168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.023139    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.023357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.023340    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.037341 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.037312    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.037423 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.037395    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v95jb\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb\") pod \"e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") " pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.199098 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.199006    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:05.491168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.491005    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:05.496977 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:36:05.496928    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb267734b_9ba1_4f14_9a22_9c3c42037fcf.slice/crio-aee89d5ac0d04444dc469badab73715ce523e38a0c358f2dca942e8254713707 WatchSource:0}: Error finding container aee89d5ac0d04444dc469badab73715ce523e38a0c358f2dca942e8254713707: Status 404 returned error can't find the container with id aee89d5ac0d04444dc469badab73715ce523e38a0c358f2dca942e8254713707
Sep 19 04:36:05.500230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.500187    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:05.500361 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.500320    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:05.500431 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.500383    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:36:05.525589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:05.525563    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" event={"ID":"b267734b-9ba1-4f14-9a22-9c3c42037fcf","Type":"ContainerStarted","Data":"aee89d5ac0d04444dc469badab73715ce523e38a0c358f2dca942e8254713707"}
Sep 19 04:36:06.533432 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:06.533386    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" event={"ID":"b267734b-9ba1-4f14-9a22-9c3c42037fcf","Type":"ContainerStarted","Data":"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"}
Sep 19 04:36:06.563924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:06.563875    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" podStartSLOduration=2.563860382 podStartE2EDuration="2.563860382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:36:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:36:06.558851109 +0000 UTC m=+1355.092832549" watchObservedRunningTime="2026-09-19 04:36:06.563860382 +0000 UTC m=+1355.097841819"
Sep 19 04:36:07.200299 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:07.200255    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:07.205634 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:07.205608    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:07.538232 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:07.538156    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:07.539041 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:07.539021    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:10.241448 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.241418    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:10.245240 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.245220    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.247658 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.247638    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-2a94cba7-serving-cert\""
Sep 19 04:36:10.260107 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.260082    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:10.281059 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.281033    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crqp4\" (UniqueName: \"kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.281181 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.281085    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.281237 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.281191    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.281302 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.281239    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.382050 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.382016    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.382237 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.382081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.382237 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.382101    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.382237 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:10.382167    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-serving-cert: secret "maas-api-e2e-derive-2a94cba7-serving-cert" not found
Sep 19 04:36:10.382237 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.382183    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crqp4\" (UniqueName: \"kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.382421 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:10.382244    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls podName:c5fafbe1-29b8-4220-bfb4-c6988ed5e157 nodeName:}" failed. No retries permitted until 2026-09-19 04:36:10.882226796 +0000 UTC m=+1359.416208216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls") pod "maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" (UID: "c5fafbe1-29b8-4220-bfb4-c6988ed5e157") : secret "maas-api-e2e-derive-2a94cba7-serving-cert" not found
Sep 19 04:36:10.382761 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.382743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.384765 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.384744    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.394226 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.394204    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crqp4\" (UniqueName: \"kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.887616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.887583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:10.890039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:10.890012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") pod \"maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:11.028447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.028415    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:11.032251 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.032234    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.034852 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.034827    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-2a94cba7-dockercfg-tkrlk\""
Sep 19 04:36:11.034987 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.034866    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-2a94cba7\""
Sep 19 04:36:11.047639 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.046785    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:11.090131 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.090098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.090326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.090304    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlm4k\" (UniqueName: \"kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.156562 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.156470    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:11.191985 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.191952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlm4k\" (UniqueName: \"kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.192136 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.192032    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.192754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.192728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.200642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.200620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlm4k\" (UniqueName: \"kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k\") pod \"payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.345455 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.344862    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:11.433750 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.433723    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:11.435391 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:36:11.435351    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5fafbe1_29b8_4220_bfb4_c6988ed5e157.slice/crio-eb18a80871c8c86b39f6ba13889e4b1f38e8a42c0b0b9e308b9f479d2269e107 WatchSource:0}: Error finding container eb18a80871c8c86b39f6ba13889e4b1f38e8a42c0b0b9e308b9f479d2269e107: Status 404 returned error can't find the container with id eb18a80871c8c86b39f6ba13889e4b1f38e8a42c0b0b9e308b9f479d2269e107
Sep 19 04:36:11.560121 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.560086    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" event={"ID":"c5fafbe1-29b8-4220-bfb4-c6988ed5e157","Type":"ContainerStarted","Data":"eb18a80871c8c86b39f6ba13889e4b1f38e8a42c0b0b9e308b9f479d2269e107"}
Sep 19 04:36:11.628215 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:11.628184    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:11.629020 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:36:11.628994    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81072f2a_94ee_4fa3_8c9c_3f88f0e40ed5.slice/crio-8d18a610c79f2a6346077cf9c738539822015699743f86b37f85b059efddce5c WatchSource:0}: Error finding container 8d18a610c79f2a6346077cf9c738539822015699743f86b37f85b059efddce5c: Status 404 returned error can't find the container with id 8d18a610c79f2a6346077cf9c738539822015699743f86b37f85b059efddce5c
Sep 19 04:36:12.454326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.454303    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:36:12.505617 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505585    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.505793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505651    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.505793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505688    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.505793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505748    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.505793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505790    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.506008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505829    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.506008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505885    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmj2z\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.506008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505883    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data" (OuterVolumeSpecName: "istio-data") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:12.506008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505917    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.506008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.505942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert\") pod \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\" (UID: \"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57\") "
Sep 19 04:36:12.506269 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506024    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:12.506269 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506080    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:12.506429 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506401    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.506429 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506411    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:12.506539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506419    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.506539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506461    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.506539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.506521    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:12.509032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.508980    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z" (OuterVolumeSpecName: "kube-api-access-wmj2z") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "kube-api-access-wmj2z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:12.509032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.508999    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:12.509032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.508982    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:36:12.509442 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.509409    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token" (OuterVolumeSpecName: "istio-token") pod "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" (UID: "93e9dcd0-62bb-4e5f-94e7-a49562c3bc57"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:12.568212 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.568184    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" event={"ID":"c5fafbe1-29b8-4220-bfb4-c6988ed5e157","Type":"ContainerStarted","Data":"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"}
Sep 19 04:36:12.568372 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.568244    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:12.569864 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.569842    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" event={"ID":"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5","Type":"ContainerStarted","Data":"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"}
Sep 19 04:36:12.569994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.569882    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" event={"ID":"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5","Type":"ContainerStarted","Data":"8d18a610c79f2a6346077cf9c738539822015699743f86b37f85b059efddce5c"}
Sep 19 04:36:12.569994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.569945    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:12.571513 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.571491    2584 generic.go:356] "Generic (PLEG): container finished" podID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerID="e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2" exitCode=0
Sep 19 04:36:12.571637 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.571542    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"
Sep 19 04:36:12.571637 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.571562    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerDied","Data":"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"}
Sep 19 04:36:12.571637 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.571593    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr" event={"ID":"93e9dcd0-62bb-4e5f-94e7-a49562c3bc57","Type":"ContainerDied","Data":"1969d4fbc2f0a1f24c64fb5f563a477ae4e788df2d0abd1563c30196981aceda"}
Sep 19 04:36:12.571637 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.571613    2584 scope.go:117] "RemoveContainer" containerID="e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"
Sep 19 04:36:12.581076 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.581058    2584 scope.go:117] "RemoveContainer" containerID="43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"
Sep 19 04:36:12.589446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.589408    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" podStartSLOduration=2.015745181 podStartE2EDuration="2.589395608s" totalImagesPullingTime="573.650427ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:36:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:36:12.586670433 +0000 UTC m=+1361.120651872" watchObservedRunningTime="2026-09-19 04:36:12.589395608 +0000 UTC m=+1361.123377080"
Sep 19 04:36:12.590798 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.590780    2584 scope.go:117] "RemoveContainer" containerID="e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"
Sep 19 04:36:12.591075 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:12.591056    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2\": container with ID starting with e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2 not found: ID does not exist" containerID="e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"
Sep 19 04:36:12.591140 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.591084    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2"} err="failed to get container status \"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2\": rpc error: code = NotFound desc = could not find container \"e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2\": container with ID starting with e0c2e98a38c0baf5770773ecb5e4a128b80fdd7126d4c04c037348bcda8b52f2 not found: ID does not exist"
Sep 19 04:36:12.591140 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.591101    2584 scope.go:117] "RemoveContainer" containerID="43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"
Sep 19 04:36:12.591343 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:12.591325    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb\": container with ID starting with 43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb not found: ID does not exist" containerID="43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"
Sep 19 04:36:12.591414 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.591346    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb"} err="failed to get container status \"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb\": rpc error: code = NotFound desc = could not find container \"43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb\": container with ID starting with 43236310cc7fcd794d42d0571129ea4e62920f72f122eccda53cc6c856aa4aeb not found: ID does not exist"
Sep 19 04:36:12.607293 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607257    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:36:12.607417 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607398    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.607479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607421    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.607479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607436    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.607479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607449    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmj2z\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-kube-api-access-wmj2z\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.607479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607462    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.607479 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.607480    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:12.614663 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.614639    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-33718462-openshift-default-847585db8d-r9htr"]
Sep 19 04:36:12.636708 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:12.636665    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" podStartSLOduration=1.636648733 podStartE2EDuration="1.636648733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:36:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:36:12.636261228 +0000 UTC m=+1361.170242679" watchObservedRunningTime="2026-09-19 04:36:12.636648733 +0000 UTC m=+1361.170630172"
Sep 19 04:36:13.967547 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:13.967518    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" path="/var/lib/kubelet/pods/93e9dcd0-62bb-4e5f-94e7-a49562c3bc57/volumes"
Sep 19 04:36:18.583922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:18.583893    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:23.580748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:23.580719    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:31.546389 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:31.546357    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:36:42.109582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.109545    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:42.110161 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.109830    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" podUID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" containerName="maas-api" containerID="cri-o://aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623" gracePeriod=30
Sep 19 04:36:42.184256 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.184177    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:42.184619 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.184439    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" podUID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" containerName="payload-pre-processing" containerID="cri-o://1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3" gracePeriod=30
Sep 19 04:36:42.441120 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.441093    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:42.451121 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.451098    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:42.501508 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.501475    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:42.501738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.501709    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" podUID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" containerName="istio-proxy" containerID="cri-o://ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426" gracePeriod=30
Sep 19 04:36:42.502395 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502263    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume\") pod \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") "
Sep 19 04:36:42.502395 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502391    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crqp4\" (UniqueName: \"kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4\") pod \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") "
Sep 19 04:36:42.502539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502432    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca\") pod \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") "
Sep 19 04:36:42.502539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502468    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs\") pod \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") "
Sep 19 04:36:42.502539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502486    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") pod \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\" (UID: \"c5fafbe1-29b8-4220-bfb4-c6988ed5e157\") "
Sep 19 04:36:42.502539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502512    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlm4k\" (UniqueName: \"kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k\") pod \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\" (UID: \"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5\") "
Sep 19 04:36:42.502799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502648    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" (UID: "81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:42.502853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.502835    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.503445 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.503188    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5fafbe1-29b8-4220-bfb4-c6988ed5e157" (UID: "c5fafbe1-29b8-4220-bfb4-c6988ed5e157"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:42.506125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.506023    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k" (OuterVolumeSpecName: "kube-api-access-xlm4k") pod "81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" (UID: "81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5"). InnerVolumeSpecName "kube-api-access-xlm4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:42.507956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.507932    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c5fafbe1-29b8-4220-bfb4-c6988ed5e157" (UID: "c5fafbe1-29b8-4220-bfb4-c6988ed5e157"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:42.508050 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.507948    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4" (OuterVolumeSpecName: "kube-api-access-crqp4") pod "c5fafbe1-29b8-4220-bfb4-c6988ed5e157" (UID: "c5fafbe1-29b8-4220-bfb4-c6988ed5e157"). InnerVolumeSpecName "kube-api-access-crqp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:42.508193 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.508174    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5fafbe1-29b8-4220-bfb4-c6988ed5e157" (UID: "c5fafbe1-29b8-4220-bfb4-c6988ed5e157"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:36:42.606310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.606248    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.606531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.606399    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.606531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.606425    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.606531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.606439    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlm4k\" (UniqueName: \"kubernetes.io/projected/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5-kube-api-access-xlm4k\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.606531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.606453    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crqp4\" (UniqueName: \"kubernetes.io/projected/c5fafbe1-29b8-4220-bfb4-c6988ed5e157-kube-api-access-crqp4\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.642115 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.642091    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:42.706948 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.706920    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.706964    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.706991    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707046    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707087    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707118    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707159    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v95jb\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707185    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data" (OuterVolumeSpecName: "istio-data") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:42.707315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707216    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707304    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket\") pod \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\" (UID: \"b267734b-9ba1-4f14-9a22-9c3c42037fcf\") "
Sep 19 04:36:42.707597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707392    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:42.707597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707564    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:42.707597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707580    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:42.707597 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707578    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:36:42.707763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707720    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.707763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707742    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.707763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707757    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.707883 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707770    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.707883 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.707783    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.709489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.709459    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:36:42.709489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.709484    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token" (OuterVolumeSpecName: "istio-token") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:42.709650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.709468    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb" (OuterVolumeSpecName: "kube-api-access-v95jb") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "kube-api-access-v95jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:36:42.709793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.709767    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b267734b-9ba1-4f14-9a22-9c3c42037fcf" (UID: "b267734b-9ba1-4f14-9a22-9c3c42037fcf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:36:42.745799 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.745778    2584 generic.go:356] "Generic (PLEG): container finished" podID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" containerID="1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3" exitCode=0
Sep 19 04:36:42.745922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.745835    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"
Sep 19 04:36:42.745922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.745866    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" event={"ID":"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5","Type":"ContainerDied","Data":"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"}
Sep 19 04:36:42.746039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.745958    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv" event={"ID":"81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5","Type":"ContainerDied","Data":"8d18a610c79f2a6346077cf9c738539822015699743f86b37f85b059efddce5c"}
Sep 19 04:36:42.746039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.745994    2584 scope.go:117] "RemoveContainer" containerID="1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"
Sep 19 04:36:42.747660 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.747638    2584 generic.go:356] "Generic (PLEG): container finished" podID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" containerID="ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426" exitCode=0
Sep 19 04:36:42.747748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.747674    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"
Sep 19 04:36:42.747748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.747724    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" event={"ID":"b267734b-9ba1-4f14-9a22-9c3c42037fcf","Type":"ContainerDied","Data":"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"}
Sep 19 04:36:42.747875 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.747776    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx" event={"ID":"b267734b-9ba1-4f14-9a22-9c3c42037fcf","Type":"ContainerDied","Data":"aee89d5ac0d04444dc469badab73715ce523e38a0c358f2dca942e8254713707"}
Sep 19 04:36:42.749311 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.749264    2584 generic.go:356] "Generic (PLEG): container finished" podID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" containerID="aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623" exitCode=0
Sep 19 04:36:42.749425 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.749333    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" event={"ID":"c5fafbe1-29b8-4220-bfb4-c6988ed5e157","Type":"ContainerDied","Data":"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"}
Sep 19 04:36:42.749425 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.749350    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"
Sep 19 04:36:42.749425 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.749370    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b" event={"ID":"c5fafbe1-29b8-4220-bfb4-c6988ed5e157","Type":"ContainerDied","Data":"eb18a80871c8c86b39f6ba13889e4b1f38e8a42c0b0b9e308b9f479d2269e107"}
Sep 19 04:36:42.758029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.757912    2584 scope.go:117] "RemoveContainer" containerID="1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"
Sep 19 04:36:42.758950 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:42.758921    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3\": container with ID starting with 1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3 not found: ID does not exist" containerID="1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"
Sep 19 04:36:42.759058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.758960    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3"} err="failed to get container status \"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3\": rpc error: code = NotFound desc = could not find container \"1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3\": container with ID starting with 1f63a3adc71a38a31a8720ea15e7956dde3cfc91fd9f88cc38ed91d6dfedc0d3 not found: ID does not exist"
Sep 19 04:36:42.759058 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.758985    2584 scope.go:117] "RemoveContainer" containerID="ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"
Sep 19 04:36:42.767763 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.767740    2584 scope.go:117] "RemoveContainer" containerID="ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"
Sep 19 04:36:42.768027 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:42.768008    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426\": container with ID starting with ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426 not found: ID does not exist" containerID="ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"
Sep 19 04:36:42.768104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.768032    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426"} err="failed to get container status \"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426\": rpc error: code = NotFound desc = could not find container \"ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426\": container with ID starting with ce45a003d115a9cf95494dd27d7dfbfffb9673cdeedda12ab0c5ebea3018f426 not found: ID does not exist"
Sep 19 04:36:42.768104 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.768047    2584 scope.go:117] "RemoveContainer" containerID="aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"
Sep 19 04:36:42.774189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.774169    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:42.776574 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.776548    2584 scope.go:117] "RemoveContainer" containerID="aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"
Sep 19 04:36:42.776891 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:36:42.776873    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623\": container with ID starting with aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623 not found: ID does not exist" containerID="aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"
Sep 19 04:36:42.776979 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.776901    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623"} err="failed to get container status \"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623\": rpc error: code = NotFound desc = could not find container \"aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623\": container with ID starting with aec9bb613a6860c9b3cc1b05d398f7fb875b740a52b35daad46140c299137623 not found: ID does not exist"
Sep 19 04:36:42.778731 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.778712    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-2a94cba7-778984fbfd-knpsv"]
Sep 19 04:36:42.789774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.789755    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:42.794198 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.794174    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-2a94cba7-openshift-default-6847bffdb8-hxpqx"]
Sep 19 04:36:42.805719 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.805692    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:42.808305 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.808265    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-2a94cba7-7d97bc66cb-98q8b"]
Sep 19 04:36:42.808694 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.808677    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v95jb\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-kube-api-access-v95jb\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.808740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.808697    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.808740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.808707    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:42.808740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:42.808716    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b267734b-9ba1-4f14-9a22-9c3c42037fcf-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:36:43.967428 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:43.967398    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" path="/var/lib/kubelet/pods/81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5/volumes"
Sep 19 04:36:43.967821 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:43.967807    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" path="/var/lib/kubelet/pods/b267734b-9ba1-4f14-9a22-9c3c42037fcf/volumes"
Sep 19 04:36:43.968159 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:43.968146    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" path="/var/lib/kubelet/pods/c5fafbe1-29b8-4220-bfb4-c6988ed5e157/volumes"
Sep 19 04:36:58.755598 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:36:58.755558    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:37:26.833132 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:26.833095    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:37:26.833594 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:26.833326    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" podUID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" containerName="maas-api" containerID="cri-o://18f72cfda832a71357229c67ffe5b58b52b15644ba84e5cbfe3698f9d38478f3" gracePeriod=30
Sep 19 04:37:26.993408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:26.993373    2584 generic.go:356] "Generic (PLEG): container finished" podID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" containerID="18f72cfda832a71357229c67ffe5b58b52b15644ba84e5cbfe3698f9d38478f3" exitCode=0
Sep 19 04:37:26.993576 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:26.993413    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" event={"ID":"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88","Type":"ContainerDied","Data":"18f72cfda832a71357229c67ffe5b58b52b15644ba84e5cbfe3698f9d38478f3"}
Sep 19 04:37:27.082864 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.082839    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:37:27.123095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.123016    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") pod \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") "
Sep 19 04:37:27.123095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.123067    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs\") pod \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") "
Sep 19 04:37:27.123343 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.123106    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9xn9\" (UniqueName: \"kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9\") pod \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") "
Sep 19 04:37:27.123343 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.123139    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca\") pod \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\" (UID: \"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88\") "
Sep 19 04:37:27.123633 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.123601    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" (UID: "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:37:27.125431 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.125405    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" (UID: "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:37:27.125539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.125430    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" (UID: "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:37:27.125539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.125487    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9" (OuterVolumeSpecName: "kube-api-access-z9xn9") pod "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" (UID: "32b721f4-4c1c-4bcf-bbe5-997fff6d9e88"). InnerVolumeSpecName "kube-api-access-z9xn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:37:27.226007 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.225971    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:37:27.226007 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.226013    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:37:27.226210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.226027    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:37:27.226210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:27.226040    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9xn9\" (UniqueName: \"kubernetes.io/projected/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88-kube-api-access-z9xn9\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:37:28.000197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:28.000163    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g" event={"ID":"32b721f4-4c1c-4bcf-bbe5-997fff6d9e88","Type":"ContainerDied","Data":"f752f84e19039bff92ba3e70e8a8e72f2441a580b17bffa3e53b68d46a72a3e2"}
Sep 19 04:37:28.000197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:28.000198    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"
Sep 19 04:37:28.000710 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:28.000222    2584 scope.go:117] "RemoveContainer" containerID="18f72cfda832a71357229c67ffe5b58b52b15644ba84e5cbfe3698f9d38478f3"
Sep 19 04:37:28.021257 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:28.021230    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:37:28.032450 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:28.032423    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-d0f416-569b79fb87-h9g6g"]
Sep 19 04:37:29.966984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:29.966952    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" path="/var/lib/kubelet/pods/32b721f4-4c1c-4bcf-bbe5-997fff6d9e88/volumes"
Sep 19 04:37:34.885029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:34.884997    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:37:56.524505 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524471    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524910    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524923    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524938    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" containerName="payload-pre-processing"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524943    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" containerName="payload-pre-processing"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524954    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" containerName="maas-api"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524963    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" containerName="maas-api"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524978    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" containerName="maas-api"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524983    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" containerName="maas-api"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524990    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.524994    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525053    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525060    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="32b721f4-4c1c-4bcf-bbe5-997fff6d9e88" containerName="maas-api"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525067    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b267734b-9ba1-4f14-9a22-9c3c42037fcf" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525076    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525081    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="81072f2a-94ee-4fa3-8c9c-3f88f0e40ed5" containerName="payload-pre-processing"
Sep 19 04:37:56.525105 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.525087    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5fafbe1-29b8-4220-bfb4-c6988ed5e157" containerName="maas-api"
Sep 19 04:37:56.528501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.528477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.530700 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.530681    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-a70050-serving-cert\""
Sep 19 04:37:56.545213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.545188    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:37:56.713250 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.713203    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pkwjz\" (UniqueName: \"kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.713250 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.713269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.713522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.713377    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.713522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.713501    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.814834 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.814808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.815008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.814892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.815008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.814937    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pkwjz\" (UniqueName: \"kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.815008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.814966    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.815182 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:37:56.815055    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-serving-cert: secret "maas-api-e2e-explicit-a70050-serving-cert" not found
Sep 19 04:37:56.815182 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:37:56.815138    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls podName:e6662529-d64b-433d-a671-29d48922dac3 nodeName:}" failed. No retries permitted until 2026-09-19 04:37:57.315117698 +0000 UTC m=+1465.849099114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls") pod "maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" (UID: "e6662529-d64b-433d-a671-29d48922dac3") : secret "maas-api-e2e-explicit-a70050-serving-cert" not found
Sep 19 04:37:56.815499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.815474    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.817493 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.817475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:56.823831 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:56.823810    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pkwjz\" (UniqueName: \"kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:57.200536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.200457    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:37:57.200872 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.200859    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:57.200923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.200874    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="93e9dcd0-62bb-4e5f-94e7-a49562c3bc57" containerName="istio-proxy"
Sep 19 04:37:57.204189 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.204174    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.206554 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.206533    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-a70050\""
Sep 19 04:37:57.206685 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.206658    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-a70050-dockercfg-tp6zv\""
Sep 19 04:37:57.214198 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.214172    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:37:57.218716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.218695    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44pc8\" (UniqueName: \"kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.218802 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.218726    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.319884 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.319847    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:57.320126 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.319959    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44pc8\" (UniqueName: \"kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.320126 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.319990    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.320886 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.320860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.322679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.322660    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") pod \"maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:57.328712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.328693    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44pc8\" (UniqueName: \"kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8\") pod \"payload-processing-e2e-explicit-a70050-d454ff54f-hktn6\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") " pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.441129 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.441103    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:57.515858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.515819    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:57.737031 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.737002    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:37:57.738957 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:37:57.738925    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6662529_d64b_433d_a671_29d48922dac3.slice/crio-fbe530708e46794f7b90d2e4eec287025f83959af6ffddfc4806343419817c95 WatchSource:0}: Error finding container fbe530708e46794f7b90d2e4eec287025f83959af6ffddfc4806343419817c95: Status 404 returned error can't find the container with id fbe530708e46794f7b90d2e4eec287025f83959af6ffddfc4806343419817c95
Sep 19 04:37:57.792399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.792376    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:37:57.793997 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:37:57.793973    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f898bba_541f_45c0_9f7d_3df1fd0951bb.slice/crio-2ae4ea4c34e3ebe22e0857ad73dff4d1ecbc144940e0bdd6ce0178ff8223fbfc WatchSource:0}: Error finding container 2ae4ea4c34e3ebe22e0857ad73dff4d1ecbc144940e0bdd6ce0178ff8223fbfc: Status 404 returned error can't find the container with id 2ae4ea4c34e3ebe22e0857ad73dff4d1ecbc144940e0bdd6ce0178ff8223fbfc
Sep 19 04:37:57.843725 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:57.843696    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:37:58.157330 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:58.157268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" event={"ID":"7f898bba-541f-45c0-9f7d-3df1fd0951bb","Type":"ContainerStarted","Data":"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"}
Sep 19 04:37:58.157475 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:58.157457    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:37:58.157568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:58.157505    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" event={"ID":"7f898bba-541f-45c0-9f7d-3df1fd0951bb","Type":"ContainerStarted","Data":"2ae4ea4c34e3ebe22e0857ad73dff4d1ecbc144940e0bdd6ce0178ff8223fbfc"}
Sep 19 04:37:58.158452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:58.158427    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" event={"ID":"e6662529-d64b-433d-a671-29d48922dac3","Type":"ContainerStarted","Data":"fbe530708e46794f7b90d2e4eec287025f83959af6ffddfc4806343419817c95"}
Sep 19 04:37:58.176416 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:58.176233    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" podStartSLOduration=1.176214838 podStartE2EDuration="1.176214838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:37:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:37:58.175770367 +0000 UTC m=+1466.709751807" watchObservedRunningTime="2026-09-19 04:37:58.176214838 +0000 UTC m=+1466.710196277"
Sep 19 04:37:59.165329 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:59.165268    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" event={"ID":"e6662529-d64b-433d-a671-29d48922dac3","Type":"ContainerStarted","Data":"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"}
Sep 19 04:37:59.165775 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:59.165561    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:37:59.193853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:37:59.193787    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" podStartSLOduration=2.810338513 podStartE2EDuration="3.193771827s" totalImagesPullingTime="383.433314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:37:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:37:59.192040925 +0000 UTC m=+1467.726022364" watchObservedRunningTime="2026-09-19 04:37:59.193771827 +0000 UTC m=+1467.727753264"
Sep 19 04:38:05.176442 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:05.176413    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:38:09.167448 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:09.167413    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:38:23.927540 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:23.927504    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:38:31.961853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:31.961829    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:38:31.964438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:31.964410    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:38:36.202417 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.202384    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:38:36.206357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.206338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.210981 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.210959    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0a4ccac4\""
Sep 19 04:38:36.211106 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.211067    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0a4ccac4-dockercfg-bbkk9\""
Sep 19 04:38:36.219179 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.219154    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:38:36.390437 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.390401    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ps4pr\" (UniqueName: \"kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.390437 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.390440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.491245 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.491146    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ps4pr\" (UniqueName: \"kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.491245 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.491199    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.491897 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.491878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.502587 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.502553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ps4pr\" (UniqueName: \"kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr\") pod \"payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.517407 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.517382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:36.796330 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:36.796307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:38:36.798975 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:38:36.798938    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75037c4c_51cc_4262_9584_6265580ac7c1.slice/crio-5ba1667c3901cf6298da274a5252c3d5bed4fff5148ebe88806869295ffd1eaf WatchSource:0}: Error finding container 5ba1667c3901cf6298da274a5252c3d5bed4fff5148ebe88806869295ffd1eaf: Status 404 returned error can't find the container with id 5ba1667c3901cf6298da274a5252c3d5bed4fff5148ebe88806869295ffd1eaf
Sep 19 04:38:37.363443 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:37.363407    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" event={"ID":"75037c4c-51cc-4262-9584-6265580ac7c1","Type":"ContainerStarted","Data":"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"}
Sep 19 04:38:37.363837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:37.363482    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" event={"ID":"75037c4c-51cc-4262-9584-6265580ac7c1","Type":"ContainerStarted","Data":"5ba1667c3901cf6298da274a5252c3d5bed4fff5148ebe88806869295ffd1eaf"}
Sep 19 04:38:37.363837 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:37.363549    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:38:47.288018 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:47.287960    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" podStartSLOduration=11.28794364 podStartE2EDuration="11.28794364s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:38:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:38:37.394919867 +0000 UTC m=+1505.928901305" watchObservedRunningTime="2026-09-19 04:38:47.28794364 +0000 UTC m=+1515.821925130"
Sep 19 04:38:47.288853 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:47.288836    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:38:48.371431 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:38:48.371406    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:39:17.867918 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:17.867882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:39:19.930102 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:19.930026    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:39:19.930477 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:19.930237    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" podUID="75037c4c-51cc-4262-9584-6265580ac7c1" containerName="payload-pre-processing" containerID="cri-o://907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998" gracePeriod=30
Sep 19 04:39:20.184561 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.184500    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:39:20.313564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.313529    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ps4pr\" (UniqueName: \"kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr\") pod \"75037c4c-51cc-4262-9584-6265580ac7c1\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") "
Sep 19 04:39:20.313728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.313657    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume\") pod \"75037c4c-51cc-4262-9584-6265580ac7c1\" (UID: \"75037c4c-51cc-4262-9584-6265580ac7c1\") "
Sep 19 04:39:20.314003 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.313973    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "75037c4c-51cc-4262-9584-6265580ac7c1" (UID: "75037c4c-51cc-4262-9584-6265580ac7c1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:39:20.315706 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.315685    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr" (OuterVolumeSpecName: "kube-api-access-ps4pr") pod "75037c4c-51cc-4262-9584-6265580ac7c1" (UID: "75037c4c-51cc-4262-9584-6265580ac7c1"). InnerVolumeSpecName "kube-api-access-ps4pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:39:20.414986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.414952    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/75037c4c-51cc-4262-9584-6265580ac7c1-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.414986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.414981    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ps4pr\" (UniqueName: \"kubernetes.io/projected/75037c4c-51cc-4262-9584-6265580ac7c1-kube-api-access-ps4pr\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:39:20.584936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.584898    2584 generic.go:356] "Generic (PLEG): container finished" podID="75037c4c-51cc-4262-9584-6265580ac7c1" containerID="907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998" exitCode=0
Sep 19 04:39:20.585095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.584957    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"
Sep 19 04:39:20.585095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.584981    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" event={"ID":"75037c4c-51cc-4262-9584-6265580ac7c1","Type":"ContainerDied","Data":"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"}
Sep 19 04:39:20.585095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.585035    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml" event={"ID":"75037c4c-51cc-4262-9584-6265580ac7c1","Type":"ContainerDied","Data":"5ba1667c3901cf6298da274a5252c3d5bed4fff5148ebe88806869295ffd1eaf"}
Sep 19 04:39:20.585095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.585057    2584 scope.go:117] "RemoveContainer" containerID="907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"
Sep 19 04:39:20.594223 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.594204    2584 scope.go:117] "RemoveContainer" containerID="907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"
Sep 19 04:39:20.594526 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:39:20.594506    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998\": container with ID starting with 907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998 not found: ID does not exist" containerID="907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"
Sep 19 04:39:20.594580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.594535    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998"} err="failed to get container status \"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998\": rpc error: code = NotFound desc = could not find container \"907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998\": container with ID starting with 907b24bceb0099b6fcb5fc787a7fb6a106ac5bf50f939d8e8b4c8e49f1637998 not found: ID does not exist"
Sep 19 04:39:20.607870 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.607835    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:39:20.610811 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:20.610792    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a4ccac4-7cdfc79858-9knml"]
Sep 19 04:39:21.969090 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:21.969062    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75037c4c-51cc-4262-9584-6265580ac7c1" path="/var/lib/kubelet/pods/75037c4c-51cc-4262-9584-6265580ac7c1/volumes"
Sep 19 04:39:40.759081 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:40.759048    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:39:43.787094 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.787062    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:39:43.787654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.787634    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75037c4c-51cc-4262-9584-6265580ac7c1" containerName="payload-pre-processing"
Sep 19 04:39:43.787654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.787654    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="75037c4c-51cc-4262-9584-6265580ac7c1" containerName="payload-pre-processing"
Sep 19 04:39:43.787793 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.787715    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="75037c4c-51cc-4262-9584-6265580ac7c1" containerName="payload-pre-processing"
Sep 19 04:39:43.791953 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.791936    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.797524 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.797491    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-c1a7b6-openshift-default-dockercfg-9tsw4\""
Sep 19 04:39:43.807376 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.807354    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:39:43.934127 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934194    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934222    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934297    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934321    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934444    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:43.934601 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:43.934529    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p95w4\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.035699 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.035858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.035858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.035858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035768    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.035858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p95w4\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036065 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036065 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036065 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.035957    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036065 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036005    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036124    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036157    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036512 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036468    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.036579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.036562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.038335 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.038316    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.038603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.038582    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.050029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.050008    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p95w4\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.050143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.050039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token\") pod \"e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") " pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.102315 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.102267    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:44.406207 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.406126    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:39:44.410025 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:39:44.409996    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92780c9c_ebe5_4b93_9f63_f476faefdf79.slice/crio-e875b05d4597687b305c653df3ca4f1937aba92ca53a05088ce8bcdd63e50921 WatchSource:0}: Error finding container e875b05d4597687b305c653df3ca4f1937aba92ca53a05088ce8bcdd63e50921: Status 404 returned error can't find the container with id e875b05d4597687b305c653df3ca4f1937aba92ca53a05088ce8bcdd63e50921
Sep 19 04:39:44.412261 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.412231    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:39:44.412371 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.412325    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:39:44.412439 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.412370    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:39:44.721470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.721378    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerStarted","Data":"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"}
Sep 19 04:39:44.721470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.721434    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerStarted","Data":"e875b05d4597687b305c653df3ca4f1937aba92ca53a05088ce8bcdd63e50921"}
Sep 19 04:39:44.747590 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:44.747533    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podStartSLOduration=1.747518265 podStartE2EDuration="1.747518265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:39:44.744993259 +0000 UTC m=+1573.278974722" watchObservedRunningTime="2026-09-19 04:39:44.747518265 +0000 UTC m=+1573.281499738"
Sep 19 04:39:45.103049 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:45.103013    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:45.108365 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:45.108341    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:45.733194 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:45.733157    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:45.734097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:45.734076    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:39:51.443047 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.443013    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:39:51.446906 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.446886    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.449510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.449487    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-c1a7b6-serving-cert\""
Sep 19 04:39:51.467038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.467014    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:39:51.614388 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.614354    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fgc5\" (UniqueName: \"kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.614568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.614413    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.614568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.614452    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.614568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.614494    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.715325 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.715211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fgc5\" (UniqueName: \"kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.715482 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.715332    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.715482 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.715378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.715482 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.715444    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.716206 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.716179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.718120 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.718095    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.718221 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.718128    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.724218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.724197    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fgc5\" (UniqueName: \"kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5\") pod \"maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:51.757346 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:51.757316    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:52.039606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.039581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:39:52.041268 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:39:52.041239    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b6a05b_8b13_4cef_aa94_3bcc8e928482.slice/crio-a97a47f4e869448a74db16e849e4767d3c56590592e0b6b9837b304adaa94756 WatchSource:0}: Error finding container a97a47f4e869448a74db16e849e4767d3c56590592e0b6b9837b304adaa94756: Status 404 returned error can't find the container with id a97a47f4e869448a74db16e849e4767d3c56590592e0b6b9837b304adaa94756
Sep 19 04:39:52.042870 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.042849    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:39:52.774738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.774641    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" event={"ID":"22b6a05b-8b13-4cef-aa94-3bcc8e928482","Type":"ContainerStarted","Data":"866cb94ead7d902f42ad8b67793c83623161d12db18f4b372313d4e1693d2f9a"}
Sep 19 04:39:52.774738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.774706    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" event={"ID":"22b6a05b-8b13-4cef-aa94-3bcc8e928482","Type":"ContainerStarted","Data":"a97a47f4e869448a74db16e849e4767d3c56590592e0b6b9837b304adaa94756"}
Sep 19 04:39:52.775145 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.774831    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:39:52.810377 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:52.810333    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" podStartSLOduration=1.443802311 podStartE2EDuration="1.81031822s" totalImagesPullingTime="366.515909ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:39:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:39:52.806398905 +0000 UTC m=+1581.340380364" watchObservedRunningTime="2026-09-19 04:39:52.81031822 +0000 UTC m=+1581.344299658"
Sep 19 04:39:58.785434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:39:58.785403    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:40:14.467906 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:14.467873    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:40:19.245989 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.245910    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:40:19.246371 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.246110    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" podUID="e6662529-d64b-433d-a671-29d48922dac3" containerName="maas-api" containerID="cri-o://11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50" gracePeriod=30
Sep 19 04:40:19.368839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.368806    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:40:19.369445 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.369393    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" podUID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" containerName="payload-processing" containerID="cri-o://1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a" gracePeriod=30
Sep 19 04:40:19.576945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.576857    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:40:19.705355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705320    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pkwjz\" (UniqueName: \"kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz\") pod \"e6662529-d64b-433d-a671-29d48922dac3\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") "
Sep 19 04:40:19.705511 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705409    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca\") pod \"e6662529-d64b-433d-a671-29d48922dac3\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") "
Sep 19 04:40:19.705511 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705489    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs\") pod \"e6662529-d64b-433d-a671-29d48922dac3\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") "
Sep 19 04:40:19.705642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705550    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") pod \"e6662529-d64b-433d-a671-29d48922dac3\" (UID: \"e6662529-d64b-433d-a671-29d48922dac3\") "
Sep 19 04:40:19.705724 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705690    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e6662529-d64b-433d-a671-29d48922dac3" (UID: "e6662529-d64b-433d-a671-29d48922dac3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:40:19.705938 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.705915    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e6662529-d64b-433d-a671-29d48922dac3-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.708351 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.708316    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz" (OuterVolumeSpecName: "kube-api-access-pkwjz") pod "e6662529-d64b-433d-a671-29d48922dac3" (UID: "e6662529-d64b-433d-a671-29d48922dac3"). InnerVolumeSpecName "kube-api-access-pkwjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:40:19.708351 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.708325    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "e6662529-d64b-433d-a671-29d48922dac3" (UID: "e6662529-d64b-433d-a671-29d48922dac3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:40:19.708534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.708422    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e6662529-d64b-433d-a671-29d48922dac3" (UID: "e6662529-d64b-433d-a671-29d48922dac3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:40:19.711712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.711693    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:40:19.806780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.806742    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume\") pod \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") "
Sep 19 04:40:19.806965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.806843    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44pc8\" (UniqueName: \"kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8\") pod \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\" (UID: \"7f898bba-541f-45c0-9f7d-3df1fd0951bb\") "
Sep 19 04:40:19.807040 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.807029    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.807079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.807041    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e6662529-d64b-433d-a671-29d48922dac3-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.807079 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.807051    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pkwjz\" (UniqueName: \"kubernetes.io/projected/e6662529-d64b-433d-a671-29d48922dac3-kube-api-access-pkwjz\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.807509 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.807485    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f898bba-541f-45c0-9f7d-3df1fd0951bb" (UID: "7f898bba-541f-45c0-9f7d-3df1fd0951bb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:40:19.809210 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.809189    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8" (OuterVolumeSpecName: "kube-api-access-44pc8") pod "7f898bba-541f-45c0-9f7d-3df1fd0951bb" (UID: "7f898bba-541f-45c0-9f7d-3df1fd0951bb"). InnerVolumeSpecName "kube-api-access-44pc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:40:19.908191 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.908153    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44pc8\" (UniqueName: \"kubernetes.io/projected/7f898bba-541f-45c0-9f7d-3df1fd0951bb-kube-api-access-44pc8\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.908191 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.908183    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f898bba-541f-45c0-9f7d-3df1fd0951bb-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:40:19.920977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.920952    2584 generic.go:356] "Generic (PLEG): container finished" podID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" containerID="1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a" exitCode=0
Sep 19 04:40:19.921111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.921005    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"
Sep 19 04:40:19.921111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.921046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" event={"ID":"7f898bba-541f-45c0-9f7d-3df1fd0951bb","Type":"ContainerDied","Data":"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"}
Sep 19 04:40:19.921225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.921109    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6" event={"ID":"7f898bba-541f-45c0-9f7d-3df1fd0951bb","Type":"ContainerDied","Data":"2ae4ea4c34e3ebe22e0857ad73dff4d1ecbc144940e0bdd6ce0178ff8223fbfc"}
Sep 19 04:40:19.921225 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.921148    2584 scope.go:117] "RemoveContainer" containerID="1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"
Sep 19 04:40:19.922472 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.922449    2584 generic.go:356] "Generic (PLEG): container finished" podID="e6662529-d64b-433d-a671-29d48922dac3" containerID="11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50" exitCode=0
Sep 19 04:40:19.922589 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.922491    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"
Sep 19 04:40:19.922641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.922488    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" event={"ID":"e6662529-d64b-433d-a671-29d48922dac3","Type":"ContainerDied","Data":"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"}
Sep 19 04:40:19.922679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.922643    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m" event={"ID":"e6662529-d64b-433d-a671-29d48922dac3","Type":"ContainerDied","Data":"fbe530708e46794f7b90d2e4eec287025f83959af6ffddfc4806343419817c95"}
Sep 19 04:40:19.932156 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.932135    2584 scope.go:117] "RemoveContainer" containerID="1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"
Sep 19 04:40:19.932502 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:40:19.932479    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a\": container with ID starting with 1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a not found: ID does not exist" containerID="1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"
Sep 19 04:40:19.932603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.932514    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a"} err="failed to get container status \"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a\": rpc error: code = NotFound desc = could not find container \"1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a\": container with ID starting with 1a0547ebb9f10bf2e9711bfb73182fc896b5d4d3c56d5ea6d20b489e0124cc8a not found: ID does not exist"
Sep 19 04:40:19.932603 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.932537    2584 scope.go:117] "RemoveContainer" containerID="11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"
Sep 19 04:40:19.941289 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.941260    2584 scope.go:117] "RemoveContainer" containerID="11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"
Sep 19 04:40:19.942066 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:40:19.942049    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50\": container with ID starting with 11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50 not found: ID does not exist" containerID="11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"
Sep 19 04:40:19.942137 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.942071    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50"} err="failed to get container status \"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50\": rpc error: code = NotFound desc = could not find container \"11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50\": container with ID starting with 11450cfee73f2f5e5c639c43a6d902ab96c53de98d372d76c8af09e5587b3d50 not found: ID does not exist"
Sep 19 04:40:19.969303 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.969255    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:40:19.969303 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.969308    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-a70050-7d97dfd67f-4sg8m"]
Sep 19 04:40:19.989452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.989421    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:40:20.000023 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:19.999987    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-a70050-d454ff54f-hktn6"]
Sep 19 04:40:21.967499 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:21.967470    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" path="/var/lib/kubelet/pods/7f898bba-541f-45c0-9f7d-3df1fd0951bb/volumes"
Sep 19 04:40:21.967989 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:21.967975    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6662529-d64b-433d-a671-29d48922dac3" path="/var/lib/kubelet/pods/e6662529-d64b-433d-a671-29d48922dac3/volumes"
Sep 19 04:40:25.960689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.960655    2584 generic.go:356] "Generic (PLEG): container finished" podID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerID="a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e" exitCode=0
Sep 19 04:40:25.961137 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.960727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerDied","Data":"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"}
Sep 19 04:40:25.961213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.961170    2584 scope.go:117] "RemoveContainer" containerID="a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"
Sep 19 04:40:25.962457 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.962427    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:25.962529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.962512    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:25.962572 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:25.962555    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:26.069254 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069221    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:40:26.069857 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069839    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" containerName="payload-processing"
Sep 19 04:40:26.069945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069859    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" containerName="payload-processing"
Sep 19 04:40:26.069945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069889    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6662529-d64b-433d-a671-29d48922dac3" containerName="maas-api"
Sep 19 04:40:26.069945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069899    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6662529-d64b-433d-a671-29d48922dac3" containerName="maas-api"
Sep 19 04:40:26.070112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.069996    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f898bba-541f-45c0-9f7d-3df1fd0951bb" containerName="payload-processing"
Sep 19 04:40:26.070112 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.070013    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6662529-d64b-433d-a671-29d48922dac3" containerName="maas-api"
Sep 19 04:40:26.073609 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.073589    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.076067 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.076042    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-eac6c5-serving-cert\""
Sep 19 04:40:26.084147 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.084114    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:40:26.166885 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.166836    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.166885 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.166886    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.167131 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.166939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd6td\" (UniqueName: \"kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.167131 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.166970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.268449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.268358    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd6td\" (UniqueName: \"kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.268449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.268419    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.268686 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.268504    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.268686 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.268537    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.268686 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:40:26.268663    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-serving-cert: secret "maas-api-e2e-shared-b-w2-eac6c5-serving-cert" not found
Sep 19 04:40:26.268848 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:40:26.268723    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls podName:edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a nodeName:}" failed. No retries permitted until 2026-09-19 04:40:26.768707669 +0000 UTC m=+1615.302689086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls") pod "maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" (UID: "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a") : secret "maas-api-e2e-shared-b-w2-eac6c5-serving-cert" not found
Sep 19 04:40:26.269190 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.269172    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.271066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.271045    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.278849 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.278822    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd6td\" (UniqueName: \"kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.773475 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.773441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.776014 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.775984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:26.970131 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.970094    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerStarted","Data":"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"}
Sep 19 04:40:26.989340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:26.989309    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:27.102541 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.102511    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:40:27.103695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.103664    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:27.103812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.103727    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:27.263322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.263139    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:40:27.265468 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:40:27.265438    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedad28b2_f3b3_42ac_ab40_1e0efbb0cb5a.slice/crio-0105e4e1833441bc8e08a36563a35b35db6c918343490463b474e1737cd4ee83 WatchSource:0}: Error finding container 0105e4e1833441bc8e08a36563a35b35db6c918343490463b474e1737cd4ee83: Status 404 returned error can't find the container with id 0105e4e1833441bc8e08a36563a35b35db6c918343490463b474e1737cd4ee83
Sep 19 04:40:27.976924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.976829    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" event={"ID":"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a","Type":"ContainerStarted","Data":"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"}
Sep 19 04:40:27.976924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.976879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" event={"ID":"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a","Type":"ContainerStarted","Data":"0105e4e1833441bc8e08a36563a35b35db6c918343490463b474e1737cd4ee83"}
Sep 19 04:40:27.977338 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:27.976925    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:28.004621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.004554    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" podStartSLOduration=1.667294491 podStartE2EDuration="2.00453528s" totalImagesPullingTime="337.240789ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:28.003465121 +0000 UTC m=+1616.537446557" watchObservedRunningTime="2026-09-19 04:40:28.00453528 +0000 UTC m=+1616.538516719"
Sep 19 04:40:28.103715 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.103617    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:28.103715 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.103700    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:28.948561 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.948531    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:40:28.952459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.952438    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:28.955039 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.955022    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-aefa94-openshift-default-dockercfg-kd7k2\""
Sep 19 04:40:28.965687 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:28.965665    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:40:29.102806 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.102757    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:29.103317 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.102829    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:29.109947 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.109900    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.110675 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.110232    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.110911 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.110889    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111236 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111219    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111370 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111352    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p78tr\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111465    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.111776 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.111759    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.212908    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.212944    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p78tr\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.212963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213008 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.212985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213103    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213399 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213260    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213454    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213515    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213818 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213723    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.213866 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.213829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.215459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.215440    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.215750 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.215728    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.223433 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.223407    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p78tr\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.225141 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.225121    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token\") pod \"e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") " pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.262809 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.262787    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:29.561216 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.561191    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:40:29.563308 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:40:29.563265    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c2ef2a_fdbc_4083_9192_1d682c7d5d8f.slice/crio-868bd2f7588df285ebb1aa5a1ad8433486072a7f874e6cc44ad8019705465ba8 WatchSource:0}: Error finding container 868bd2f7588df285ebb1aa5a1ad8433486072a7f874e6cc44ad8019705465ba8: Status 404 returned error can't find the container with id 868bd2f7588df285ebb1aa5a1ad8433486072a7f874e6cc44ad8019705465ba8
Sep 19 04:40:29.565669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.565639    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:29.565740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.565706    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:29.565740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:29.565733    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:40:30.015365 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.015220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" event={"ID":"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f","Type":"ContainerStarted","Data":"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"}
Sep 19 04:40:30.015365 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.015316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" event={"ID":"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f","Type":"ContainerStarted","Data":"868bd2f7588df285ebb1aa5a1ad8433486072a7f874e6cc44ad8019705465ba8"}
Sep 19 04:40:30.039679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.039631    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" podStartSLOduration=2.03961469 podStartE2EDuration="2.03961469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:40:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:40:30.03766148 +0000 UTC m=+1618.571642924" watchObservedRunningTime="2026-09-19 04:40:30.03961469 +0000 UTC m=+1618.573596180"
Sep 19 04:40:30.103122 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.102693    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:30.103122 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.102756    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:30.264010 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.263972    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:30.269224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.269163    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:30.733314 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:30.733262    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:40:31.021149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:31.021060    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:31.022118 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:31.022097    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:40:31.103300 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:31.102689    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:31.103300 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:31.102755    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:32.102958 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:32.102926    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:32.103154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:32.103125    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:33.103599 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:33.103552    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 19 04:40:33.104014 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:33.103623    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 19 04:40:34.013922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:34.013894    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:40:34.108027 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:34.107997    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:40:34.109103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:34.109082    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:40:47.655540 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:40:47.655507    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:41:09.869462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.869428    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:41:09.873510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.873493    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:09.876642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.876615    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-a0ed681d-serving-cert\""
Sep 19 04:41:09.892964 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.892940    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:41:09.924444 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.924405    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:09.924579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.924463    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqffc\" (UniqueName: \"kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:09.924579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.924549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:09.924686 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:09.924610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.025824 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.025785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.026032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.025861    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqffc\" (UniqueName: \"kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.026032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.025969    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.026032 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.026029    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.026217 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:41:10.026186    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-serving-cert: secret "maas-api-e2e-mt-a0ed681d-serving-cert" not found
Sep 19 04:41:10.026313 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:41:10.026247    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls podName:0c380dea-abdd-4913-865b-ccb5042c7c20 nodeName:}" failed. No retries permitted until 2026-09-19 04:41:10.526226789 +0000 UTC m=+1659.060208222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls") pod "maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" (UID: "0c380dea-abdd-4913-865b-ccb5042c7c20") : secret "maas-api-e2e-mt-a0ed681d-serving-cert" not found
Sep 19 04:41:10.026636 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.026608    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.028616 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.028589    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.046074 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.046025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqffc\" (UniqueName: \"kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.532783 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.532752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.535433 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.535409    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") pod \"maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:10.787242 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:10.787152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:11.092689 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:11.092659    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:41:11.094852 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:41:11.094825    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c380dea_abdd_4913_865b_ccb5042c7c20.slice/crio-c5d5bd08ba63fddbc6411de5b527802ddb80e51c38034eccb2894dcd9e26b1e1 WatchSource:0}: Error finding container c5d5bd08ba63fddbc6411de5b527802ddb80e51c38034eccb2894dcd9e26b1e1: Status 404 returned error can't find the container with id c5d5bd08ba63fddbc6411de5b527802ddb80e51c38034eccb2894dcd9e26b1e1
Sep 19 04:41:11.238807 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:11.238773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" event={"ID":"0c380dea-abdd-4913-865b-ccb5042c7c20","Type":"ContainerStarted","Data":"c5d5bd08ba63fddbc6411de5b527802ddb80e51c38034eccb2894dcd9e26b1e1"}
Sep 19 04:41:12.245935 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:12.245901    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" event={"ID":"0c380dea-abdd-4913-865b-ccb5042c7c20","Type":"ContainerStarted","Data":"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"}
Sep 19 04:41:12.246362 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:12.245978    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:12.273447 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:12.273403    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" podStartSLOduration=2.831786791 podStartE2EDuration="3.273389805s" totalImagesPullingTime="441.603014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:41:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:41:12.272571008 +0000 UTC m=+1660.806552447" watchObservedRunningTime="2026-09-19 04:41:12.273389805 +0000 UTC m=+1660.807371242"
Sep 19 04:41:18.256529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:18.256499    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:41:22.348852 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:41:22.348816    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:42:02.508113 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:02.508036    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:42:11.144687 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.144658    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:42:11.145180 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.144854    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" podUID="aa70044e-19ed-4d1d-8347-c529d059ae9b" containerName="maas-api" containerID="cri-o://1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674" gracePeriod=30
Sep 19 04:42:11.221703 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.221671    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:42:11.221887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.221866    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" podUID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" containerName="payload-pre-processing" containerID="cri-o://e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547" gracePeriod=30
Sep 19 04:42:11.474095 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.473803    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:42:11.513406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.513376    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:42:11.579064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.579033    2584 generic.go:356] "Generic (PLEG): container finished" podID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" containerID="e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547" exitCode=0
Sep 19 04:42:11.579231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.579088    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"
Sep 19 04:42:11.579231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.579132    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" event={"ID":"6e8aa4bb-ec5c-4880-9409-3fc308201d20","Type":"ContainerDied","Data":"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"}
Sep 19 04:42:11.579231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.579196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8" event={"ID":"6e8aa4bb-ec5c-4880-9409-3fc308201d20","Type":"ContainerDied","Data":"a1d33a1c26c2f764b77f7da8be6709654ac39b854e85524118fde790106ea050"}
Sep 19 04:42:11.579231 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.579227    2584 scope.go:117] "RemoveContainer" containerID="e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"
Sep 19 04:42:11.580887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.580817    2584 generic.go:356] "Generic (PLEG): container finished" podID="aa70044e-19ed-4d1d-8347-c529d059ae9b" containerID="1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674" exitCode=0
Sep 19 04:42:11.580887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.580882    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"
Sep 19 04:42:11.581064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.580886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" event={"ID":"aa70044e-19ed-4d1d-8347-c529d059ae9b","Type":"ContainerDied","Data":"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"}
Sep 19 04:42:11.581064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.580955    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65" event={"ID":"aa70044e-19ed-4d1d-8347-c529d059ae9b","Type":"ContainerDied","Data":"7f83a0bf21c423e39bde75141e78d537889cb03acc66047b8ccccd590d3b8bdd"}
Sep 19 04:42:11.591240 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.591221    2584 scope.go:117] "RemoveContainer" containerID="e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"
Sep 19 04:42:11.591528 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:11.591510    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547\": container with ID starting with e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547 not found: ID does not exist" containerID="e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"
Sep 19 04:42:11.591595 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.591537    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547"} err="failed to get container status \"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547\": rpc error: code = NotFound desc = could not find container \"e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547\": container with ID starting with e84ff7cd3d808f6f64aac994928a29301a8f195cfb1cc5ece662f8d51dcc6547 not found: ID does not exist"
Sep 19 04:42:11.591595 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.591557    2584 scope.go:117] "RemoveContainer" containerID="1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"
Sep 19 04:42:11.599930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.599914    2584 scope.go:117] "RemoveContainer" containerID="1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"
Sep 19 04:42:11.600174 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:11.600153    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674\": container with ID starting with 1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674 not found: ID does not exist" containerID="1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"
Sep 19 04:42:11.600220 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.600180    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674"} err="failed to get container status \"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674\": rpc error: code = NotFound desc = could not find container \"1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674\": container with ID starting with 1cf4b9cff998301d4a8fdf092edd1a054b2566e3bdc742f58d4f7432eee64674 not found: ID does not exist"
Sep 19 04:42:11.638227 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638184    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume\") pod \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") "
Sep 19 04:42:11.638393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638328    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca\") pod \"aa70044e-19ed-4d1d-8347-c529d059ae9b\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") "
Sep 19 04:42:11.638393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638373    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8h888\" (UniqueName: \"kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888\") pod \"aa70044e-19ed-4d1d-8347-c529d059ae9b\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") "
Sep 19 04:42:11.638510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638415    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls\") pod \"aa70044e-19ed-4d1d-8347-c529d059ae9b\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") "
Sep 19 04:42:11.638510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638454    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrvlt\" (UniqueName: \"kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt\") pod \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\" (UID: \"6e8aa4bb-ec5c-4880-9409-3fc308201d20\") "
Sep 19 04:42:11.638510 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638495    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs\") pod \"aa70044e-19ed-4d1d-8347-c529d059ae9b\" (UID: \"aa70044e-19ed-4d1d-8347-c529d059ae9b\") "
Sep 19 04:42:11.638726 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638699    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e8aa4bb-ec5c-4880-9409-3fc308201d20" (UID: "6e8aa4bb-ec5c-4880-9409-3fc308201d20"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:11.638920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.638702    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa70044e-19ed-4d1d-8347-c529d059ae9b" (UID: "aa70044e-19ed-4d1d-8347-c529d059ae9b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:11.639071 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.639039    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e8aa4bb-ec5c-4880-9409-3fc308201d20-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.639146 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.639081    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa70044e-19ed-4d1d-8347-c529d059ae9b-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.641060 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.641036    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888" (OuterVolumeSpecName: "kube-api-access-8h888") pod "aa70044e-19ed-4d1d-8347-c529d059ae9b" (UID: "aa70044e-19ed-4d1d-8347-c529d059ae9b"). InnerVolumeSpecName "kube-api-access-8h888". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:11.641169 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.641153    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "aa70044e-19ed-4d1d-8347-c529d059ae9b" (UID: "aa70044e-19ed-4d1d-8347-c529d059ae9b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:42:11.641236 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.641176    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt" (OuterVolumeSpecName: "kube-api-access-hrvlt") pod "6e8aa4bb-ec5c-4880-9409-3fc308201d20" (UID: "6e8aa4bb-ec5c-4880-9409-3fc308201d20"). InnerVolumeSpecName "kube-api-access-hrvlt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:11.641393 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.641378    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa70044e-19ed-4d1d-8347-c529d059ae9b" (UID: "aa70044e-19ed-4d1d-8347-c529d059ae9b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:42:11.740613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.740518    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrvlt\" (UniqueName: \"kubernetes.io/projected/6e8aa4bb-ec5c-4880-9409-3fc308201d20-kube-api-access-hrvlt\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.740613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.740547    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.740613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.740557    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8h888\" (UniqueName: \"kubernetes.io/projected/aa70044e-19ed-4d1d-8347-c529d059ae9b-kube-api-access-8h888\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.740613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.740565    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa70044e-19ed-4d1d-8347-c529d059ae9b-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:11.912930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.912904    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:42:11.918660 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.918635    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-bcbdad-5b5779c474-gt6p8"]
Sep 19 04:42:11.934716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.934680    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:42:11.938878 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.938855    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-bcbdad-7cd758b659-4zz65"]
Sep 19 04:42:11.968531 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.968501    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" path="/var/lib/kubelet/pods/6e8aa4bb-ec5c-4880-9409-3fc308201d20/volumes"
Sep 19 04:42:11.968941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:11.968927    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa70044e-19ed-4d1d-8347-c529d059ae9b" path="/var/lib/kubelet/pods/aa70044e-19ed-4d1d-8347-c529d059ae9b/volumes"
Sep 19 04:42:18.884750 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:18.884721    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:42:18.885151 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:18.884933    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" containerID="cri-o://497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436" gracePeriod=30
Sep 19 04:42:20.559088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:20.559052    2584 patch_prober.go:28] interesting pod/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 19 04:42:20.559568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:20.559119    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 19 04:42:24.135780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.135758    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:42:24.153500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153441    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153472    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfknz\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153500 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153490    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153510    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153527    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153593    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153654    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153790    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token\") pod \"ca26fbb1-b772-4927-b171-662527c7cb0d\" (UID: \"ca26fbb1-b772-4927-b171-662527c7cb0d\") "
Sep 19 04:42:24.153965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153823    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:24.153965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153810    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:24.153965 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.153892    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:24.154223 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154002    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:24.154223 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154043    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:24.154395 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154376    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.154461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154400    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca26fbb1-b772-4927-b171-662527c7cb0d-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.154461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154415    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.154461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154428    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.154461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.154441    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.155865 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.155848    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:42:24.155978 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.155963    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:24.156171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.156142    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:24.156171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.156149    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz" (OuterVolumeSpecName: "kube-api-access-mfknz") pod "ca26fbb1-b772-4927-b171-662527c7cb0d" (UID: "ca26fbb1-b772-4927-b171-662527c7cb0d"). InnerVolumeSpecName "kube-api-access-mfknz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:24.255291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.255251    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.255451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.255312    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.255451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.255347    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfknz\" (UniqueName: \"kubernetes.io/projected/ca26fbb1-b772-4927-b171-662527c7cb0d-kube-api-access-mfknz\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.255451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.255357    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca26fbb1-b772-4927-b171-662527c7cb0d-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:24.660900 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.660867    2584 generic.go:356] "Generic (PLEG): container finished" podID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerID="497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436" exitCode=0
Sep 19 04:42:24.661071 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.660951    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"
Sep 19 04:42:24.661071 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.661004    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerDied","Data":"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"}
Sep 19 04:42:24.661175 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.661107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8" event={"ID":"ca26fbb1-b772-4927-b171-662527c7cb0d","Type":"ContainerDied","Data":"23b7e3906002abed131393fc08841e52713a71c8a8049dc3debce0d0dea53248"}
Sep 19 04:42:24.661175 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.661139    2584 scope.go:117] "RemoveContainer" containerID="497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"
Sep 19 04:42:24.670887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.670866    2584 scope.go:117] "RemoveContainer" containerID="78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"
Sep 19 04:42:24.679196 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.679179    2584 scope.go:117] "RemoveContainer" containerID="497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"
Sep 19 04:42:24.679488 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:24.679469    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436\": container with ID starting with 497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436 not found: ID does not exist" containerID="497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"
Sep 19 04:42:24.679564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.679495    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436"} err="failed to get container status \"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436\": rpc error: code = NotFound desc = could not find container \"497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436\": container with ID starting with 497a54424c8f0ec64fada5e492b4e87f9907db5f74878b981049f9d80ad3a436 not found: ID does not exist"
Sep 19 04:42:24.679564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.679514    2584 scope.go:117] "RemoveContainer" containerID="78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"
Sep 19 04:42:24.679755 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:24.679737    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135\": container with ID starting with 78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135 not found: ID does not exist" containerID="78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"
Sep 19 04:42:24.679805 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.679763    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135"} err="failed to get container status \"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135\": rpc error: code = NotFound desc = could not find container \"78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135\": container with ID starting with 78e55a492e0e24230f6cb8cc6384df7fa878b9aff5f0527ed6512042873a0135 not found: ID does not exist"
Sep 19 04:42:24.691604 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.691583    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:42:24.697406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:24.697384    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-bcbdad-openshift-default-59c9576cd-dlcn8"]
Sep 19 04:42:25.967377 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:25.967347    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" path="/var/lib/kubelet/pods/ca26fbb1-b772-4927-b171-662527c7cb0d/volumes"
Sep 19 04:42:29.805839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:29.805801    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:42:29.806336 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:29.806090    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerName="maas-api" containerID="cri-o://ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18" gracePeriod=30
Sep 19 04:42:29.925486 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:29.925378    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.42:8443/health\": dial tcp 10.132.0.42:8443: connect: connection refused"
Sep 19 04:42:30.056556 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.056500    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:42:30.110200 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.110172    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs\") pod \"3c11c209-80f7-463e-b73f-d32b9126cf00\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") "
Sep 19 04:42:30.110396 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.110365    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca\") pod \"3c11c209-80f7-463e-b73f-d32b9126cf00\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") "
Sep 19 04:42:30.110396 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.110393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdtm8\" (UniqueName: \"kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8\") pod \"3c11c209-80f7-463e-b73f-d32b9126cf00\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") "
Sep 19 04:42:30.110514 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.110417    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls\") pod \"3c11c209-80f7-463e-b73f-d32b9126cf00\" (UID: \"3c11c209-80f7-463e-b73f-d32b9126cf00\") "
Sep 19 04:42:30.110774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.110743    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c11c209-80f7-463e-b73f-d32b9126cf00" (UID: "3c11c209-80f7-463e-b73f-d32b9126cf00"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:30.112638 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.112612    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c11c209-80f7-463e-b73f-d32b9126cf00" (UID: "3c11c209-80f7-463e-b73f-d32b9126cf00"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:42:30.112731 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.112645    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c11c209-80f7-463e-b73f-d32b9126cf00" (UID: "3c11c209-80f7-463e-b73f-d32b9126cf00"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:42:30.112731 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.112651    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8" (OuterVolumeSpecName: "kube-api-access-bdtm8") pod "3c11c209-80f7-463e-b73f-d32b9126cf00" (UID: "3c11c209-80f7-463e-b73f-d32b9126cf00"). InnerVolumeSpecName "kube-api-access-bdtm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:30.212190 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.212151    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c11c209-80f7-463e-b73f-d32b9126cf00-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.212461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.212442    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdtm8\" (UniqueName: \"kubernetes.io/projected/3c11c209-80f7-463e-b73f-d32b9126cf00-kube-api-access-bdtm8\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.212598 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.212569    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.212598 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.212601    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c11c209-80f7-463e-b73f-d32b9126cf00-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:30.692899 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.692865    2584 generic.go:356] "Generic (PLEG): container finished" podID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerID="ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18" exitCode=0
Sep 19 04:42:30.693056 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.692916    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"
Sep 19 04:42:30.693056 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.692959    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" event={"ID":"3c11c209-80f7-463e-b73f-d32b9126cf00","Type":"ContainerDied","Data":"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"}
Sep 19 04:42:30.693056 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.693019    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs" event={"ID":"3c11c209-80f7-463e-b73f-d32b9126cf00","Type":"ContainerDied","Data":"c4851e139c19eed36f4fd68f30111dd628ba04776edf811c862a4c96b23e0858"}
Sep 19 04:42:30.693056 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.693049    2584 scope.go:117] "RemoveContainer" containerID="ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"
Sep 19 04:42:30.702593 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.702575    2584 scope.go:117] "RemoveContainer" containerID="ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"
Sep 19 04:42:30.702856 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:30.702838    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18\": container with ID starting with ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18 not found: ID does not exist" containerID="ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"
Sep 19 04:42:30.702913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.702865    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18"} err="failed to get container status \"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18\": rpc error: code = NotFound desc = could not find container \"ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18\": container with ID starting with ec65b93cfb133af4b2c4edd03e59aa5c0b889119124a95cdee7798b5f3fccc18 not found: ID does not exist"
Sep 19 04:42:30.734361 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.734328    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:42:30.736159 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:30.736140    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-6b1935-57d746f95b-brggs"]
Sep 19 04:42:31.967702 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:31.967672    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" path="/var/lib/kubelet/pods/3c11c209-80f7-463e-b73f-d32b9126cf00/volumes"
Sep 19 04:42:39.728594 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.728552    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:42:39.729224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729202    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:39.729355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729252    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:39.729355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729268    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerName="maas-api"
Sep 19 04:42:39.729355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729296    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerName="maas-api"
Sep 19 04:42:39.729355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729316    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" containerName="payload-pre-processing"
Sep 19 04:42:39.729355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729324    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" containerName="payload-pre-processing"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729360    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa70044e-19ed-4d1d-8347-c529d059ae9b" containerName="maas-api"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729368    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa70044e-19ed-4d1d-8347-c529d059ae9b" containerName="maas-api"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729486    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e8aa4bb-ec5c-4880-9409-3fc308201d20" containerName="payload-pre-processing"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729503    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729511    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa70044e-19ed-4d1d-8347-c529d059ae9b" containerName="maas-api"
Sep 19 04:42:39.729606 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.729525    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c11c209-80f7-463e-b73f-d32b9126cf00" containerName="maas-api"
Sep 19 04:42:39.734213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.734191    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.737184 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.737165    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-561bb1-openshift-default-dockercfg-gdmc4\""
Sep 19 04:42:39.749162 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.749134    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:42:39.804744 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804713    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.804920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.804920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804787    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.804920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804837    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.804920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804873    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wx7b\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.804920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804895    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.805148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804939    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.805148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.804958    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.805148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.805032    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.899523 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.899481    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:42:39.899854 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.899820    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" podUID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" containerName="istio-proxy" containerID="cri-o://9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690" gracePeriod=30
Sep 19 04:42:39.909922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.909888    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910037 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.909991    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910036    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910103 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910063    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910100    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910133    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wx7b\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910372 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910206    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910372 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910372 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910889 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910857    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.910982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.910907    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.911340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.911316    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.911467 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.911365    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.912923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.912902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.913654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.913636    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.926077 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.926054    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wx7b\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:39.926669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:39.926649    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token\") pod \"e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") " pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:40.045870 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.045841    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:40.363164 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.363141    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:42:40.365014 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:42:40.364983    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43a95d71_94ba_4e8c_b90a_b01fc7ce0db8.slice/crio-89131032af923831b2a60bbae6730a184c00e00f59c3fd3cb33dfd89d0da78a8 WatchSource:0}: Error finding container 89131032af923831b2a60bbae6730a184c00e00f59c3fd3cb33dfd89d0da78a8: Status 404 returned error can't find the container with id 89131032af923831b2a60bbae6730a184c00e00f59c3fd3cb33dfd89d0da78a8
Sep 19 04:42:40.367145 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.367111    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:42:40.367248 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.367191    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:42:40.367248 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.367237    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:42:40.662141 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.662061    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:42:40.748899 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.748862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerStarted","Data":"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"}
Sep 19 04:42:40.749254 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.748920    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerStarted","Data":"89131032af923831b2a60bbae6730a184c00e00f59c3fd3cb33dfd89d0da78a8"}
Sep 19 04:42:40.777766 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:40.777716    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podStartSLOduration=1.7777001220000002 podStartE2EDuration="1.777700122s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:42:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:42:40.777508715 +0000 UTC m=+1749.311490154" watchObservedRunningTime="2026-09-19 04:42:40.777700122 +0000 UTC m=+1749.311681560"
Sep 19 04:42:41.046655 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:41.046625    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:41.051705 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:41.051685    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:41.753811 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:41.753779    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:41.754725 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:41.754703    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:42:45.165249 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.165190    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:42:45.264536 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264498    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264554    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264634    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264659    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264687    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p78tr\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264944 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264726    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264944 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264779    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264944 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264804    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264944 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket\") pod \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\" (UID: \"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f\") "
Sep 19 04:42:45.264944 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.264904    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:45.265166 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265037    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:42:45.265219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265186    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.265219 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265206    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.265359 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265338    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:45.265656 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265530    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:45.265769 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.265751    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:45.267015 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.266987    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr" (OuterVolumeSpecName: "kube-api-access-p78tr") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "kube-api-access-p78tr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:45.267118 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.267100    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:42:45.267259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.267243    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:42:45.267330 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.267316    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" (UID: "b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:42:45.366578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366543    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366574    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366583    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366592    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366600    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366608    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p78tr\" (UniqueName: \"kubernetes.io/projected/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-kube-api-access-p78tr\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.366813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.366619    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:42:45.776186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.776155    2584 generic.go:356] "Generic (PLEG): container finished" podID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" containerID="9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690" exitCode=0
Sep 19 04:42:45.776186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.776191    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" event={"ID":"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f","Type":"ContainerDied","Data":"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"}
Sep 19 04:42:45.776480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.776216    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"
Sep 19 04:42:45.776480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.776301    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9" event={"ID":"b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f","Type":"ContainerDied","Data":"868bd2f7588df285ebb1aa5a1ad8433486072a7f874e6cc44ad8019705465ba8"}
Sep 19 04:42:45.776480 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.776334    2584 scope.go:117] "RemoveContainer" containerID="9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"
Sep 19 04:42:45.788994 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.788975    2584 scope.go:117] "RemoveContainer" containerID="9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"
Sep 19 04:42:45.789320 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:45.789268    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690\": container with ID starting with 9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690 not found: ID does not exist" containerID="9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"
Sep 19 04:42:45.789410 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.789333    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690"} err="failed to get container status \"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690\": rpc error: code = NotFound desc = could not find container \"9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690\": container with ID starting with 9c7fd95357db8df6bec958c7f343554ead7eeaf56a27997199a3a33515810690 not found: ID does not exist"
Sep 19 04:42:45.803418 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.803389    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:42:45.811129 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.811107    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-aefa94-openshift-default-5456c5ffb4-n9tj9"]
Sep 19 04:42:45.967685 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:45.967660    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" path="/var/lib/kubelet/pods/b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f/volumes"
Sep 19 04:42:47.210096 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210060    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:42:47.210489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210476    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" containerName="istio-proxy"
Sep 19 04:42:47.210534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210491    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" containerName="istio-proxy"
Sep 19 04:42:47.210534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210505    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:47.210534 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210510    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:47.210631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210582    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c2ef2a-fdbc-4083-9192-1d682c7d5d8f" containerName="istio-proxy"
Sep 19 04:42:47.210631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.210593    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca26fbb1-b772-4927-b171-662527c7cb0d" containerName="istio-proxy"
Sep 19 04:42:47.214949 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.214920    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.217695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.217672    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-561bb1-serving-cert\""
Sep 19 04:42:47.236350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.236321    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:42:47.287970 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.287931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.288168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.287977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.288168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.288018    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.288168 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.288038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfxh\" (UniqueName: \"kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.389072 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.389031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.389264 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.389081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.389264 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.389136    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.389264 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.389161    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfxh\" (UniqueName: \"kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.389264 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:47.389191    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-serving-cert: secret "maas-api-e2e-shared-a-w3-561bb1-serving-cert" not found
Sep 19 04:42:47.389264 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:42:47.389259    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls podName:0aeb193c-df31-4e01-85f6-ad6b238cc9ef nodeName:}" failed. No retries permitted until 2026-09-19 04:42:47.889241276 +0000 UTC m=+1756.423222692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls") pod "maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" (UID: "0aeb193c-df31-4e01-85f6-ad6b238cc9ef") : secret "maas-api-e2e-shared-a-w3-561bb1-serving-cert" not found
Sep 19 04:42:47.389859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.389836    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.391746 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.391724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.401700 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.401673    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfxh\" (UniqueName: \"kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.894710 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.894671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:47.897324 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:47.897302    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:48.125130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.125093    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:48.171073 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.170991    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:42:48.175402 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.174938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.178611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.177892    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-561bb1\""
Sep 19 04:42:48.179202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.179163    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-561bb1-dockercfg-vslz2\""
Sep 19 04:42:48.197869 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.197825    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:42:48.299262 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.299231    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz4hz\" (UniqueName: \"kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.299660 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.299269    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.400608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.400573    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz4hz\" (UniqueName: \"kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.400608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.400613    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.401228 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.401209    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.405593 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.405573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:42:48.407648 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:42:48.407619    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0aeb193c_df31_4e01_85f6_ad6b238cc9ef.slice/crio-84fd67d7b42a7183041d1b4c115c928833af1795d1fa3366079b0026b2adc13e WatchSource:0}: Error finding container 84fd67d7b42a7183041d1b4c115c928833af1795d1fa3366079b0026b2adc13e: Status 404 returned error can't find the container with id 84fd67d7b42a7183041d1b4c115c928833af1795d1fa3366079b0026b2adc13e
Sep 19 04:42:48.413320 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.413265    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz4hz\" (UniqueName: \"kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz\") pod \"payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.495295 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.495194    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:48.772317 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.772221    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:42:48.775087 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:42:48.775049    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb426cfa2_5507_48d0_9750_342b9c8adda6.slice/crio-392ee94b9807259e64dba7f5c243bc27f7c8ab3a52a3ff1d2404b2a675ad2287 WatchSource:0}: Error finding container 392ee94b9807259e64dba7f5c243bc27f7c8ab3a52a3ff1d2404b2a675ad2287: Status 404 returned error can't find the container with id 392ee94b9807259e64dba7f5c243bc27f7c8ab3a52a3ff1d2404b2a675ad2287
Sep 19 04:42:48.801349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.801316    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" event={"ID":"0aeb193c-df31-4e01-85f6-ad6b238cc9ef","Type":"ContainerStarted","Data":"84fd67d7b42a7183041d1b4c115c928833af1795d1fa3366079b0026b2adc13e"}
Sep 19 04:42:48.802516 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:48.802489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" event={"ID":"b426cfa2-5507-48d0-9750-342b9c8adda6","Type":"ContainerStarted","Data":"392ee94b9807259e64dba7f5c243bc27f7c8ab3a52a3ff1d2404b2a675ad2287"}
Sep 19 04:42:49.809805 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.809765    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" event={"ID":"0aeb193c-df31-4e01-85f6-ad6b238cc9ef","Type":"ContainerStarted","Data":"1af2557711acea646b254e8c791b364b043379fd091133f9faf0f5db28ba1d26"}
Sep 19 04:42:49.810303 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.809894    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:42:49.811372 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.811352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" event={"ID":"b426cfa2-5507-48d0-9750-342b9c8adda6","Type":"ContainerStarted","Data":"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"}
Sep 19 04:42:49.811494 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.811481    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:42:49.835881 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.835839    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" podStartSLOduration=2.25273386 podStartE2EDuration="2.835823872s" totalImagesPullingTime="583.090012ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:42:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:42:49.832834071 +0000 UTC m=+1758.366815508" watchObservedRunningTime="2026-09-19 04:42:49.835823872 +0000 UTC m=+1758.369805310"
Sep 19 04:42:49.857001 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:49.856950    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" podStartSLOduration=1.856932253 podStartE2EDuration="1.856932253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:42:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:42:49.855257908 +0000 UTC m=+1758.389239345" watchObservedRunningTime="2026-09-19 04:42:49.856932253 +0000 UTC m=+1758.390913691"
Sep 19 04:42:55.821827 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:42:55.821792    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:43:00.817879 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:00.817841    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:43:12.796497 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:12.796450    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 19 04:43:12.796887 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:12.796538    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 19 04:43:13.570778 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.570745    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:43:13.574688 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.574670    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.577926 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.577908    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-8bbcca-openshift-default-dockercfg-6jsn8\""
Sep 19 04:43:13.596841 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.596814    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:43:13.654084 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654051    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654084 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654093    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654135    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654153    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654319    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.654349 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.654338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7jpw\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755171 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755177    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7jpw\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755232    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755321    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755371    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755403 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755394    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755689    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755724    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755787 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755758    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.755945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.755888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.756244 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.756227    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.757618 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.757602    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.757905 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.757888    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.763990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.763970    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7jpw\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.764955 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.764934    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token\") pod \"e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") " pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.885360 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.885245    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:13.955046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.954847    2584 generic.go:356] "Generic (PLEG): container finished" podID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerID="214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d" exitCode=0
Sep 19 04:43:13.955046 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.954943    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerDied","Data":"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"}
Sep 19 04:43:13.955795 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.955766    2584 scope.go:117] "RemoveContainer" containerID="214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"
Sep 19 04:43:13.957521 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.957480    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:13.957620 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.957575    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:13.957663 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:13.957648    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:14.189144 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.189060    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:43:14.196214 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:43:14.196189    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode251a177_8916_41c8_afce_7ba4dcdb3523.slice/crio-f34d42d11a8ccbdb9b413047f36ac79e793cf1e1c47f17428462f9429c99fc1c WatchSource:0}: Error finding container f34d42d11a8ccbdb9b413047f36ac79e793cf1e1c47f17428462f9429c99fc1c: Status 404 returned error can't find the container with id f34d42d11a8ccbdb9b413047f36ac79e793cf1e1c47f17428462f9429c99fc1c
Sep 19 04:43:14.198847 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.198810    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:14.198919 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.198899    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:14.198976 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.198941    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:14.962834 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.962804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerStarted","Data":"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"}
Sep 19 04:43:14.964408 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.964375    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerStarted","Data":"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"}
Sep 19 04:43:14.964539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:14.964426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerStarted","Data":"f34d42d11a8ccbdb9b413047f36ac79e793cf1e1c47f17428462f9429c99fc1c"}
Sep 19 04:43:15.015388 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.015327    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podStartSLOduration=2.015310535 podStartE2EDuration="2.015310535s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:43:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:43:15.012443773 +0000 UTC m=+1783.546425212" watchObservedRunningTime="2026-09-19 04:43:15.015310535 +0000 UTC m=+1783.549291973"
Sep 19 04:43:15.046917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.046887    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:43:15.047135 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.047114    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:15.047215 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.047169    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:15.885935 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.885896    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:15.898117 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.898079    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:15.975340 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.975303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:15.976160 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:15.976132    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:16.046703 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:16.046664    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:16.046897 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:16.046740    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:17.046630 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:17.046592    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:17.046993 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:17.046649    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:18.046879 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:18.046844    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:18.047249 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:18.046897    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:19.046459 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:19.046427    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:19.046644 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:19.046488    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:19.469902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:19.469821    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:43:20.046579 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:20.046543    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:20.046761 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:20.046596    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:21.046161 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:21.046130    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 19 04:43:21.046582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:21.046178    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 19 04:43:22.050116 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:22.050090    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:43:22.050594 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:22.050380    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:43:22.051074 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:22.051059    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:43:24.133899 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.133867    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:43:24.138592 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.138575    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.144730 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.144705    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-8bbcca\""
Sep 19 04:43:24.168361 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.168333    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:43:24.265982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.265943    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.266186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.266086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vx6z8\" (UniqueName: \"kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.367524 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.367484    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vx6z8\" (UniqueName: \"kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.367690 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.367585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.368224 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.368206    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.375852 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.375824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vx6z8\" (UniqueName: \"kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8\") pod \"payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.449781 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.449707    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:24.724625 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:24.724592    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:43:24.726190 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:43:24.726169    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a70474a_0831_4db7_8fc5_285186029ccf.slice/crio-9ea7c20b5e7c965fac5ec928c1dc9d864e70b3bf37397a06bc242a5a99af84b1 WatchSource:0}: Error finding container 9ea7c20b5e7c965fac5ec928c1dc9d864e70b3bf37397a06bc242a5a99af84b1: Status 404 returned error can't find the container with id 9ea7c20b5e7c965fac5ec928c1dc9d864e70b3bf37397a06bc242a5a99af84b1
Sep 19 04:43:25.032698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:25.032597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" event={"ID":"0a70474a-0831-4db7-8fc5-285186029ccf","Type":"ContainerStarted","Data":"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"}
Sep 19 04:43:25.032698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:25.032660    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" event={"ID":"0a70474a-0831-4db7-8fc5-285186029ccf","Type":"ContainerStarted","Data":"9ea7c20b5e7c965fac5ec928c1dc9d864e70b3bf37397a06bc242a5a99af84b1"}
Sep 19 04:43:25.032698 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:25.032685    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:25.056759 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:25.056711    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" podStartSLOduration=1.056695815 podStartE2EDuration="1.056695815s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:43:25.056177773 +0000 UTC m=+1793.590159212" watchObservedRunningTime="2026-09-19 04:43:25.056695815 +0000 UTC m=+1793.590677253"
Sep 19 04:43:31.999738 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:31.999704    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:43:32.004221 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:32.004193    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:43:36.039423 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:36.039394    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:43:45.376615 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.376582    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:43:45.377060 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.376799    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" podUID="0c380dea-abdd-4913-865b-ccb5042c7c20" containerName="maas-api" containerID="cri-o://f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2" gracePeriod=30
Sep 19 04:43:45.664066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.664040    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:43:45.800304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.798613    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqffc\" (UniqueName: \"kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc\") pod \"0c380dea-abdd-4913-865b-ccb5042c7c20\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") "
Sep 19 04:43:45.800304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.798691    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca\") pod \"0c380dea-abdd-4913-865b-ccb5042c7c20\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") "
Sep 19 04:43:45.800304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.798750    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs\") pod \"0c380dea-abdd-4913-865b-ccb5042c7c20\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") "
Sep 19 04:43:45.800304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.798832    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") pod \"0c380dea-abdd-4913-865b-ccb5042c7c20\" (UID: \"0c380dea-abdd-4913-865b-ccb5042c7c20\") "
Sep 19 04:43:45.800304 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.799910    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c380dea-abdd-4913-865b-ccb5042c7c20" (UID: "0c380dea-abdd-4913-865b-ccb5042c7c20"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:43:45.813709 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.813669    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c380dea-abdd-4913-865b-ccb5042c7c20" (UID: "0c380dea-abdd-4913-865b-ccb5042c7c20"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:43:45.815016 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.814988    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c380dea-abdd-4913-865b-ccb5042c7c20" (UID: "0c380dea-abdd-4913-865b-ccb5042c7c20"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:43:45.817134 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.816727    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc" (OuterVolumeSpecName: "kube-api-access-jqffc") pod "0c380dea-abdd-4913-865b-ccb5042c7c20" (UID: "0c380dea-abdd-4913-865b-ccb5042c7c20"). InnerVolumeSpecName "kube-api-access-jqffc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:43:45.903969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.903862    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c380dea-abdd-4913-865b-ccb5042c7c20-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.903969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.903893    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.903969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.903908    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c380dea-abdd-4913-865b-ccb5042c7c20-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:43:45.903969 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:45.903918    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqffc\" (UniqueName: \"kubernetes.io/projected/0c380dea-abdd-4913-865b-ccb5042c7c20-kube-api-access-jqffc\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:43:46.149558 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.149522    2584 generic.go:356] "Generic (PLEG): container finished" podID="0c380dea-abdd-4913-865b-ccb5042c7c20" containerID="f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2" exitCode=0
Sep 19 04:43:46.149747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.149587    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"
Sep 19 04:43:46.149747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.149609    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" event={"ID":"0c380dea-abdd-4913-865b-ccb5042c7c20","Type":"ContainerDied","Data":"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"}
Sep 19 04:43:46.149747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.149700    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz" event={"ID":"0c380dea-abdd-4913-865b-ccb5042c7c20","Type":"ContainerDied","Data":"c5d5bd08ba63fddbc6411de5b527802ddb80e51c38034eccb2894dcd9e26b1e1"}
Sep 19 04:43:46.149747 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.149727    2584 scope.go:117] "RemoveContainer" containerID="f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"
Sep 19 04:43:46.158946 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.158929    2584 scope.go:117] "RemoveContainer" containerID="f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"
Sep 19 04:43:46.159207 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:43:46.159188    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2\": container with ID starting with f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2 not found: ID does not exist" containerID="f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"
Sep 19 04:43:46.159289 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.159220    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2"} err="failed to get container status \"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2\": rpc error: code = NotFound desc = could not find container \"f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2\": container with ID starting with f73d6526acbcbe5137583e1f026d70c4013a5d5fb8282ffa95b17d2c5dad88b2 not found: ID does not exist"
Sep 19 04:43:46.166765 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.166741    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:43:46.172756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:46.172735    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-a0ed681d-694cd5979b-xpfkz"]
Sep 19 04:43:47.967679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:47.967645    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c380dea-abdd-4913-865b-ccb5042c7c20" path="/var/lib/kubelet/pods/0c380dea-abdd-4913-865b-ccb5042c7c20/volumes"
Sep 19 04:43:54.199604 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.199566    2584 generic.go:356] "Generic (PLEG): container finished" podID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerID="875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632" exitCode=0
Sep 19 04:43:54.200012 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.199639    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerDied","Data":"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"}
Sep 19 04:43:54.200066 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.200052    2584 scope.go:117] "RemoveContainer" containerID="875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"
Sep 19 04:43:54.201369 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.201344    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:54.201445 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.201408    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:54.201445 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:54.201438    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:43:55.209646 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:55.209608    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerStarted","Data":"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"}
Sep 19 04:43:55.886565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:55.886526    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:43:55.886764 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:55.886647    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 04:43:55.886764 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:55.886691    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 04:43:56.886322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:56.886254    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 04:43:56.886912 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:56.886879    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 04:43:57.886529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:57.886486    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 04:43:57.887129 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:57.887095    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 04:43:58.886611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:58.886562    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 04:43:58.887124 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:58.886638    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 04:43:59.886201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:59.885732    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 19 04:43:59.886201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:43:59.885804    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 19 04:44:00.890054 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:44:00.890024    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:44:00.890462 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:44:00.890393    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:44:00.891029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:44:00.891011    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:44:04.674398 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:44:04.674357    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:44:43.576539 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:44:43.576507    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:45:00.188139 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.188064    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"]
Sep 19 04:45:00.188628 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.188593    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c380dea-abdd-4913-865b-ccb5042c7c20" containerName="maas-api"
Sep 19 04:45:00.188628 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.188608    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c380dea-abdd-4913-865b-ccb5042c7c20" containerName="maas-api"
Sep 19 04:45:00.188707 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.188676    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c380dea-abdd-4913-865b-ccb5042c7c20" containerName="maas-api"
Sep 19 04:45:00.191728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.191712    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"
Sep 19 04:45:00.194413 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.194392    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-s6xbq\""
Sep 19 04:45:00.201143 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.201122    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"
Sep 19 04:45:00.233602 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.232845    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"]
Sep 19 04:45:00.484002 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.483921    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"]
Sep 19 04:45:00.486559 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:45:00.486534    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cbc5afb_7d6a_4325_b880_2208c403ae37.slice/crio-44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d WatchSource:0}: Error finding container 44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d: Status 404 returned error can't find the container with id 44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d
Sep 19 04:45:00.489145 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.489125    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:45:00.560363 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:00.560310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l" event={"ID":"2cbc5afb-7d6a-4325-b880-2208c403ae37","Type":"ContainerStarted","Data":"44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d"}
Sep 19 04:45:03.579695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:03.579657    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l" event={"ID":"2cbc5afb-7d6a-4325-b880-2208c403ae37","Type":"ContainerStarted","Data":"741f2faa8017aa072d49957e4e7d733e11678cd0a6af8a7d9bfda8709a2e3801"}
Sep 19 04:45:03.628618 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:03.628569    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l" podStartSLOduration=1.462996928 podStartE2EDuration="3.628553923s" totalImagesPullingTime="2.165556995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:45:03.627476676 +0000 UTC m=+1892.161458114" watchObservedRunningTime="2026-09-19 04:45:03.628553923 +0000 UTC m=+1892.162535365"
Sep 19 04:45:04.585933 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:04.585898    2584 generic.go:356] "Generic (PLEG): container finished" podID="2cbc5afb-7d6a-4325-b880-2208c403ae37" containerID="741f2faa8017aa072d49957e4e7d733e11678cd0a6af8a7d9bfda8709a2e3801" exitCode=0
Sep 19 04:45:04.586394 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:04.585959    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l" event={"ID":"2cbc5afb-7d6a-4325-b880-2208c403ae37","Type":"ContainerDied","Data":"741f2faa8017aa072d49957e4e7d733e11678cd0a6af8a7d9bfda8709a2e3801"}
Sep 19 04:45:05.727382 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:05.727351    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"
Sep 19 04:45:06.598416 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:06.598386    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l" event={"ID":"2cbc5afb-7d6a-4325-b880-2208c403ae37","Type":"ContainerDied","Data":"44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d"}
Sep 19 04:45:06.598582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:06.598441    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="44d1655828add2bf20b5bf567df565650e67a4c894735fc47ede229fa355682d"
Sep 19 04:45:06.598582 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:06.598398    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"
Sep 19 04:45:51.756778 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:51.756740    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:45:58.752498 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.752458    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:45:58.753091 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.753074    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cbc5afb-7d6a-4325-b880-2208c403ae37" containerName="cleanup"
Sep 19 04:45:58.753148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.753093    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cbc5afb-7d6a-4325-b880-2208c403ae37" containerName="cleanup"
Sep 19 04:45:58.753228 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.753163    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cbc5afb-7d6a-4325-b880-2208c403ae37" containerName="cleanup"
Sep 19 04:45:58.759752 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.759732    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:58.764117 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.764090    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-1a212c\""
Sep 19 04:45:58.764255 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.764089    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-1a212c-dockercfg-6klzr\""
Sep 19 04:45:58.775185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.775157    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:45:58.903703 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.903665    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j58bp\" (UniqueName: \"kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:58.903886 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:58.903776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.004446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.004361    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j58bp\" (UniqueName: \"kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.004592 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.004451    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.005156 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.005136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.015958 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.015927    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j58bp\" (UniqueName: \"kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp\") pod \"payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.070173 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.070120    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.348635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.348604    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:45:59.350375 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:45:59.350337    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec96bd1e_3821_45bf_8c82_564272773f0d.slice/crio-81ea3c55df7aaf06ca1088b7755157c812a1dbe2a9575c8428d480cd24fe5856 WatchSource:0}: Error finding container 81ea3c55df7aaf06ca1088b7755157c812a1dbe2a9575c8428d480cd24fe5856: Status 404 returned error can't find the container with id 81ea3c55df7aaf06ca1088b7755157c812a1dbe2a9575c8428d480cd24fe5856
Sep 19 04:45:59.889679 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.889645    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" event={"ID":"ec96bd1e-3821-45bf-8c82-564272773f0d","Type":"ContainerStarted","Data":"3c72ddef88c942f674ce33c17fb3776b3500abf8af648363482a186180fed68c"}
Sep 19 04:45:59.890088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.889697    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" event={"ID":"ec96bd1e-3821-45bf-8c82-564272773f0d","Type":"ContainerStarted","Data":"81ea3c55df7aaf06ca1088b7755157c812a1dbe2a9575c8428d480cd24fe5856"}
Sep 19 04:45:59.890088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.889837    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:45:59.911464 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:45:59.911419    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" podStartSLOduration=1.91140466 podStartE2EDuration="1.91140466s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:45:59.909593323 +0000 UTC m=+1948.443574762" watchObservedRunningTime="2026-09-19 04:45:59.91140466 +0000 UTC m=+1948.445386095"
Sep 19 04:46:10.896704 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:10.896669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:46:24.148909 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.148879    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:46:24.152613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.152595    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.155370 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.155349    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-29f7a5-openshift-default-dockercfg-cz5t2\""
Sep 19 04:46:24.167587 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.167563    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:46:24.264063 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264385 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264366    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264600 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264570    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k57wd\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264742 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264742 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264742 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264732    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264910 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264775    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264910 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264799    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.264910 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.264832    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366441 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366406    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k57wd\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366462    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366491    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366549    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366635 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366873 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366904    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.366936 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.366986    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.367014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.367167    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.367306    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.367653 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.367635    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.368954 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.368931    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.369584 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.369565    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.374917 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.374898    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.375088 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.375066    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k57wd\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd\") pod \"e2e-api-b-29f7a5-openshift-default-6874949578-76nkc\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") " pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.463314 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.463219    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:24.759354 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.759323    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:46:24.762589 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:46:24.762561    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cdfa91_d894_4550_90e0_a59f3033e9aa.slice/crio-92df47e651526849f00f09ffd37cab9008d639264348ebf57e2148e8d165788e WatchSource:0}: Error finding container 92df47e651526849f00f09ffd37cab9008d639264348ebf57e2148e8d165788e: Status 404 returned error can't find the container with id 92df47e651526849f00f09ffd37cab9008d639264348ebf57e2148e8d165788e
Sep 19 04:46:24.765368 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.765338    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:24.765434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.765401    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:24.765472 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:24.765430    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:46:25.032756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:25.032640    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerStarted","Data":"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"}
Sep 19 04:46:25.032756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:25.032719    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerStarted","Data":"92df47e651526849f00f09ffd37cab9008d639264348ebf57e2148e8d165788e"}
Sep 19 04:46:25.064149 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:25.064097    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podStartSLOduration=1.064083388 podStartE2EDuration="1.064083388s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:46:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:46:25.061783852 +0000 UTC m=+1973.595765291" watchObservedRunningTime="2026-09-19 04:46:25.064083388 +0000 UTC m=+1973.598064826"
Sep 19 04:46:25.464167 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:25.464126    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:25.469258 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:25.469231    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:26.038891 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:26.038842    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:26.039817 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:26.039796    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:46:32.762649 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.762612    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:46:32.766357 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.766338    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.770364 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.770339    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-29f7a5-serving-cert\""
Sep 19 04:46:32.784326 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.784301    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:46:32.851757 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.851719    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.851757 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.851754    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.851945 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.851919    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.851983 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.851951    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vp6fb\" (UniqueName: \"kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.953352 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.953322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.953352 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.953357    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.953568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.953518    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.953568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.953552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vp6fb\" (UniqueName: \"kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.954118 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.954064    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.955949 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.955929    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.956097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.956081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:32.962186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:32.962166    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vp6fb\" (UniqueName: \"kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb\") pod \"maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:33.077068 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:33.077041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:33.357621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:33.357594    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:46:33.358842 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:46:33.358820    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea399f9c_6c9e_494b_af0f_6b865a80c0d9.slice/crio-c5d561a8e6ecd428ca889fcf22e159475448d2c92725db128950a376f4ea43b5 WatchSource:0}: Error finding container c5d561a8e6ecd428ca889fcf22e159475448d2c92725db128950a376f4ea43b5: Status 404 returned error can't find the container with id c5d561a8e6ecd428ca889fcf22e159475448d2c92725db128950a376f4ea43b5
Sep 19 04:46:34.082858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:34.082823    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" event={"ID":"ea399f9c-6c9e-494b-af0f-6b865a80c0d9","Type":"ContainerStarted","Data":"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"}
Sep 19 04:46:34.083233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:34.082891    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:46:34.083233 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:34.082920    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" event={"ID":"ea399f9c-6c9e-494b-af0f-6b865a80c0d9","Type":"ContainerStarted","Data":"c5d561a8e6ecd428ca889fcf22e159475448d2c92725db128950a376f4ea43b5"}
Sep 19 04:46:34.108298 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:34.108242    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" podStartSLOduration=1.761804743 podStartE2EDuration="2.108226723s" totalImagesPullingTime="346.42198ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:46:34.106540814 +0000 UTC m=+1982.640522253" watchObservedRunningTime="2026-09-19 04:46:34.108226723 +0000 UTC m=+1982.642208161"
Sep 19 04:46:37.358084 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:37.358049    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:46:40.095400 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:46:40.095371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:47:16.103699 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.103661    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:47:16.104198 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.103938    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" podUID="ec96bd1e-3821-45bf-8c82-564272773f0d" containerName="payload-pre-processing" containerID="cri-o://3c72ddef88c942f674ce33c17fb3776b3500abf8af648363482a186180fed68c" gracePeriod=30
Sep 19 04:47:16.334661 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.334621    2584 generic.go:356] "Generic (PLEG): container finished" podID="ec96bd1e-3821-45bf-8c82-564272773f0d" containerID="3c72ddef88c942f674ce33c17fb3776b3500abf8af648363482a186180fed68c" exitCode=0
Sep 19 04:47:16.334827 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.334695    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" event={"ID":"ec96bd1e-3821-45bf-8c82-564272773f0d","Type":"ContainerDied","Data":"3c72ddef88c942f674ce33c17fb3776b3500abf8af648363482a186180fed68c"}
Sep 19 04:47:16.336477 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.336455    2584 generic.go:356] "Generic (PLEG): container finished" podID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerID="9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321" exitCode=0
Sep 19 04:47:16.336595 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.336495    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerDied","Data":"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"}
Sep 19 04:47:16.336916 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.336902    2584 scope.go:117] "RemoveContainer" containerID="9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"
Sep 19 04:47:16.338092 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.338066    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:47:16.338165 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.338129    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:47:16.338165 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.338160    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892140Ki","pods":"250"}
Sep 19 04:47:16.403468 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.403445    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:47:16.592123 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.592078    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j58bp\" (UniqueName: \"kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp\") pod \"ec96bd1e-3821-45bf-8c82-564272773f0d\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") "
Sep 19 04:47:16.592321 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.592129    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume\") pod \"ec96bd1e-3821-45bf-8c82-564272773f0d\" (UID: \"ec96bd1e-3821-45bf-8c82-564272773f0d\") "
Sep 19 04:47:16.592523 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.592493    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ec96bd1e-3821-45bf-8c82-564272773f0d" (UID: "ec96bd1e-3821-45bf-8c82-564272773f0d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:16.592695 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.592677    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ec96bd1e-3821-45bf-8c82-564272773f0d-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:16.594154 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.594125    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp" (OuterVolumeSpecName: "kube-api-access-j58bp") pod "ec96bd1e-3821-45bf-8c82-564272773f0d" (UID: "ec96bd1e-3821-45bf-8c82-564272773f0d"). InnerVolumeSpecName "kube-api-access-j58bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:16.693803 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:16.693722    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j58bp\" (UniqueName: \"kubernetes.io/projected/ec96bd1e-3821-45bf-8c82-564272773f0d-kube-api-access-j58bp\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:17.344117 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.344081    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerStarted","Data":"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"}
Sep 19 04:47:17.345535 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.345512    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm" event={"ID":"ec96bd1e-3821-45bf-8c82-564272773f0d","Type":"ContainerDied","Data":"81ea3c55df7aaf06ca1088b7755157c812a1dbe2a9575c8428d480cd24fe5856"}
Sep 19 04:47:17.345674 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.345542    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"
Sep 19 04:47:17.345674 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.345567    2584 scope.go:117] "RemoveContainer" containerID="3c72ddef88c942f674ce33c17fb3776b3500abf8af648363482a186180fed68c"
Sep 19 04:47:17.380526 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.380501    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:47:17.387140 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.387118    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-1a212c-6965d8d958-h82bm"]
Sep 19 04:47:17.463663 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.463635    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:17.463840 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.463819    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:17.463920 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.463871    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:17.968263 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:17.968231    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec96bd1e-3821-45bf-8c82-564272773f0d" path="/var/lib/kubelet/pods/ec96bd1e-3821-45bf-8c82-564272773f0d/volumes"
Sep 19 04:47:18.464138 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:18.464105    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:18.464546 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:18.464159    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:19.464376 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:19.464343    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:19.464754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:19.464396    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:20.464083 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:20.464046    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:20.464239 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:20.464101    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:21.463835 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:21.463803    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:21.464208 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:21.463855    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:22.463564 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:22.463527    2584 patch_prober.go:28] interesting pod/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body=
Sep 19 04:47:22.463744 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:22.463603    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused"
Sep 19 04:47:22.772861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:22.772770    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:47:23.467949 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:23.467916    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:23.468321 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:23.468296    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:23.468862 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:23.468843    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:40.018484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.018453    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:47:40.018883 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.018655    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerName="maas-api" containerID="cri-o://b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff" gracePeriod=30
Sep 19 04:47:40.091185 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.091138    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.68:8443/health\": dial tcp 10.132.0.68:8443: connect: connection refused"
Sep 19 04:47:40.300748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.300650    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:47:40.419642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.419613    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls\") pod \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") "
Sep 19 04:47:40.419819 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.419677    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs\") pod \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") "
Sep 19 04:47:40.419819 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.419794    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca\") pod \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") "
Sep 19 04:47:40.419913 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.419872    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vp6fb\" (UniqueName: \"kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb\") pod \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\" (UID: \"ea399f9c-6c9e-494b-af0f-6b865a80c0d9\") "
Sep 19 04:47:40.420148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.420115    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ea399f9c-6c9e-494b-af0f-6b865a80c0d9" (UID: "ea399f9c-6c9e-494b-af0f-6b865a80c0d9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:40.420473 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.420311    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.421977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.421948    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ea399f9c-6c9e-494b-af0f-6b865a80c0d9" (UID: "ea399f9c-6c9e-494b-af0f-6b865a80c0d9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:40.421977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.421970    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ea399f9c-6c9e-494b-af0f-6b865a80c0d9" (UID: "ea399f9c-6c9e-494b-af0f-6b865a80c0d9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:40.422120 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.421967    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb" (OuterVolumeSpecName: "kube-api-access-vp6fb") pod "ea399f9c-6c9e-494b-af0f-6b865a80c0d9" (UID: "ea399f9c-6c9e-494b-af0f-6b865a80c0d9"). InnerVolumeSpecName "kube-api-access-vp6fb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:40.512697 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.512662    2584 generic.go:356] "Generic (PLEG): container finished" podID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerID="b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff" exitCode=0
Sep 19 04:47:40.512860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.512705    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"
Sep 19 04:47:40.512860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.512751    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" event={"ID":"ea399f9c-6c9e-494b-af0f-6b865a80c0d9","Type":"ContainerDied","Data":"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"}
Sep 19 04:47:40.512860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.512804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg" event={"ID":"ea399f9c-6c9e-494b-af0f-6b865a80c0d9","Type":"ContainerDied","Data":"c5d561a8e6ecd428ca889fcf22e159475448d2c92725db128950a376f4ea43b5"}
Sep 19 04:47:40.512860 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.512830    2584 scope.go:117] "RemoveContainer" containerID="b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"
Sep 19 04:47:40.521161 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.521136    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vp6fb\" (UniqueName: \"kubernetes.io/projected/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-kube-api-access-vp6fb\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.521302 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.521162    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.521302 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.521176    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ea399f9c-6c9e-494b-af0f-6b865a80c0d9-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:40.522783 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.522767    2584 scope.go:117] "RemoveContainer" containerID="b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"
Sep 19 04:47:40.523083 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:47:40.523063    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff\": container with ID starting with b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff not found: ID does not exist" containerID="b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"
Sep 19 04:47:40.523147 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.523094    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff"} err="failed to get container status \"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff\": rpc error: code = NotFound desc = could not find container \"b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff\": container with ID starting with b85ca785c42d552ceb4addeb1f2edcd37baad1e46865caf2e72d4d9feb9c4cff not found: ID does not exist"
Sep 19 04:47:40.561489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.561463    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:47:40.585001 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:40.584975    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-29f7a5-5dc5d49d6f-b29vg"]
Sep 19 04:47:41.967471 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:41.967439    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" path="/var/lib/kubelet/pods/ea399f9c-6c9e-494b-af0f-6b865a80c0d9/volumes"
Sep 19 04:47:47.277122 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:47.277081    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:47:47.277631 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:47.277319    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy" containerID="cri-o://e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a" gracePeriod=30
Sep 19 04:47:52.535481 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.535453    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:52.578038 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.578002    2584 generic.go:356] "Generic (PLEG): container finished" podID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerID="e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a" exitCode=0
Sep 19 04:47:52.578218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.578117    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"
Sep 19 04:47:52.578218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.578141    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerDied","Data":"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"}
Sep 19 04:47:52.578218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.578199    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc" event={"ID":"60cdfa91-d894-4550-90e0-a59f3033e9aa","Type":"ContainerDied","Data":"92df47e651526849f00f09ffd37cab9008d639264348ebf57e2148e8d165788e"}
Sep 19 04:47:52.578409 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.578226    2584 scope.go:117] "RemoveContainer" containerID="e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"
Sep 19 04:47:52.587483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.587460    2584 scope.go:117] "RemoveContainer" containerID="9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"
Sep 19 04:47:52.595739 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.595725    2584 scope.go:117] "RemoveContainer" containerID="e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"
Sep 19 04:47:52.596001 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:47:52.595975    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a\": container with ID starting with e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a not found: ID does not exist" containerID="e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"
Sep 19 04:47:52.596043 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.596010    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a"} err="failed to get container status \"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a\": rpc error: code = NotFound desc = could not find container \"e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a\": container with ID starting with e60acac910f16618bf5f3213692d17e3506c7af2383dcdfb1552ffa0d0e6222a not found: ID does not exist"
Sep 19 04:47:52.596043 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.596027    2584 scope.go:117] "RemoveContainer" containerID="9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"
Sep 19 04:47:52.596291 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:47:52.596260    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321\": container with ID starting with 9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321 not found: ID does not exist" containerID="9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"
Sep 19 04:47:52.596342 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.596309    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321"} err="failed to get container status \"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321\": rpc error: code = NotFound desc = could not find container \"9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321\": container with ID starting with 9f1020c31bacb88ea85eabf8246208e7a5ecff764bc63fe9c5ae4d7f0101a321 not found: ID does not exist"
Sep 19 04:47:52.633650 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633611    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.633797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633673    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k57wd\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.633797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633699    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.633797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633724    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.633797 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633796    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.634019 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633834    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.634019 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633911    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.634019 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633951    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.634019 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.633983    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket\") pod \"60cdfa91-d894-4550-90e0-a59f3033e9aa\" (UID: \"60cdfa91-d894-4550-90e0-a59f3033e9aa\") "
Sep 19 04:47:52.634221 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634114    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data" (OuterVolumeSpecName: "istio-data") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:52.634221 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634144    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:52.634507 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634382    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:52.634813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634436    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/60cdfa91-d894-4550-90e0-a59f3033e9aa-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.634813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634772    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.634813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634604    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:52.634813 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.634631    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:52.636061 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.636037    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:47:52.636161 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.636114    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:47:52.636538 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.636518    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd" (OuterVolumeSpecName: "kube-api-access-k57wd") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "kube-api-access-k57wd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:52.636621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.636544    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token" (OuterVolumeSpecName: "istio-token") pod "60cdfa91-d894-4550-90e0-a59f3033e9aa" (UID: "60cdfa91-d894-4550-90e0-a59f3033e9aa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:52.735923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735878    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.735923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735919    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.735923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735928    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.735923 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735937    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.736202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735945    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k57wd\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-kube-api-access-k57wd\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.736202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735953    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.736202 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.735961    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/60cdfa91-d894-4550-90e0-a59f3033e9aa-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:52.916197 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.916161    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:47:52.934982 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:52.934952    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-29f7a5-openshift-default-6874949578-76nkc"]
Sep 19 04:47:53.968028 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:53.967995    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" path="/var/lib/kubelet/pods/60cdfa91-d894-4550-90e0-a59f3033e9aa/volumes"
Sep 19 04:47:55.585181 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:55.585145    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:47:58.430443 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.430400    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:47:58.430925 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.430628    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" podUID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" containerName="maas-api" containerID="cri-o://866cb94ead7d902f42ad8b67793c83623161d12db18f4b372313d4e1693d2f9a" gracePeriod=30
Sep 19 04:47:58.467811 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.467784    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"]
Sep 19 04:47:58.470859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.470835    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-c1a7b6-29829885-lpl5l"]
Sep 19 04:47:58.612367 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.612332    2584 generic.go:356] "Generic (PLEG): container finished" podID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" containerID="866cb94ead7d902f42ad8b67793c83623161d12db18f4b372313d4e1693d2f9a" exitCode=0
Sep 19 04:47:58.612513 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.612396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" event={"ID":"22b6a05b-8b13-4cef-aa94-3bcc8e928482","Type":"ContainerDied","Data":"866cb94ead7d902f42ad8b67793c83623161d12db18f4b372313d4e1693d2f9a"}
Sep 19 04:47:58.682024 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.681964    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:47:58.798325 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.798265    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fgc5\" (UniqueName: \"kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5\") pod \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") "
Sep 19 04:47:58.798522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.798336    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs\") pod \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") "
Sep 19 04:47:58.798522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.798413    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca\") pod \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") "
Sep 19 04:47:58.798522 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.798489    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls\") pod \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\" (UID: \"22b6a05b-8b13-4cef-aa94-3bcc8e928482\") "
Sep 19 04:47:58.798831 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.798800    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "22b6a05b-8b13-4cef-aa94-3bcc8e928482" (UID: "22b6a05b-8b13-4cef-aa94-3bcc8e928482"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:47:58.800723 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.800698    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "22b6a05b-8b13-4cef-aa94-3bcc8e928482" (UID: "22b6a05b-8b13-4cef-aa94-3bcc8e928482"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:58.800812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.800721    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "22b6a05b-8b13-4cef-aa94-3bcc8e928482" (UID: "22b6a05b-8b13-4cef-aa94-3bcc8e928482"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:47:58.800812 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.800704    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5" (OuterVolumeSpecName: "kube-api-access-5fgc5") pod "22b6a05b-8b13-4cef-aa94-3bcc8e928482" (UID: "22b6a05b-8b13-4cef-aa94-3bcc8e928482"). InnerVolumeSpecName "kube-api-access-5fgc5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:47:58.899711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.899676    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:58.899711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.899704    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/22b6a05b-8b13-4cef-aa94-3bcc8e928482-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:58.899711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.899716    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/22b6a05b-8b13-4cef-aa94-3bcc8e928482-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:58.899956 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:58.899724    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fgc5\" (UniqueName: \"kubernetes.io/projected/22b6a05b-8b13-4cef-aa94-3bcc8e928482-kube-api-access-5fgc5\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:47:59.620034 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.619996    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9" event={"ID":"22b6a05b-8b13-4cef-aa94-3bcc8e928482","Type":"ContainerDied","Data":"a97a47f4e869448a74db16e849e4767d3c56590592e0b6b9837b304adaa94756"}
Sep 19 04:47:59.620453 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.620060    2584 scope.go:117] "RemoveContainer" containerID="866cb94ead7d902f42ad8b67793c83623161d12db18f4b372313d4e1693d2f9a"
Sep 19 04:47:59.620453 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.620015    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"
Sep 19 04:47:59.643062 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.643030    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:47:59.645990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.645965    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-c1a7b6-898f6f657-qsnz9"]
Sep 19 04:47:59.968488 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.968411    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" path="/var/lib/kubelet/pods/22b6a05b-8b13-4cef-aa94-3bcc8e928482/volumes"
Sep 19 04:47:59.968727 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:47:59.968712    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2cbc5afb-7d6a-4325-b880-2208c403ae37" path="/var/lib/kubelet/pods/2cbc5afb-7d6a-4325-b880-2208c403ae37/volumes"
Sep 19 04:48:06.246766 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:06.246731    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:48:06.247163 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:06.246941    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy" containerID="cri-o://e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8" gracePeriod=30
Sep 19 04:48:11.507593 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.507566    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:48:11.527230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527157    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527203    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527230 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527222    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527257    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527304    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527359    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527414    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p95w4\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527483 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527467    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy\") pod \"92780c9c-ebe5-4b93-9f63-f476faefdf79\" (UID: \"92780c9c-ebe5-4b93-9f63-f476faefdf79\") "
Sep 19 04:48:11.527788 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527611    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:48:11.527788 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527668    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:11.527891 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527814    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data" (OuterVolumeSpecName: "istio-data") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:11.527891 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527856    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:11.527986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527912    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92780c9c-ebe5-4b93-9f63-f476faefdf79-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.527986 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.527931    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.528148 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.528021    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:11.529898 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.529868    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:48:11.529898 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.529891    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4" (OuterVolumeSpecName: "kube-api-access-p95w4") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "kube-api-access-p95w4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:11.530082 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.529967    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:48:11.530082 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.530065    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token" (OuterVolumeSpecName: "istio-token") pod "92780c9c-ebe5-4b93-9f63-f476faefdf79" (UID: "92780c9c-ebe5-4b93-9f63-f476faefdf79"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:11.629211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629180    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629209    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629218    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p95w4\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-kube-api-access-p95w4\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629227    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629235    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629242    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92780c9c-ebe5-4b93-9f63-f476faefdf79-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.629484 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.629250    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92780c9c-ebe5-4b93-9f63-f476faefdf79-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:11.692085 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.692052    2584 generic.go:356] "Generic (PLEG): container finished" podID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerID="e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8" exitCode=0
Sep 19 04:48:11.692310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.692108    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"
Sep 19 04:48:11.692310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.692135    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerDied","Data":"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"}
Sep 19 04:48:11.692310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.692197    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n" event={"ID":"92780c9c-ebe5-4b93-9f63-f476faefdf79","Type":"ContainerDied","Data":"e875b05d4597687b305c653df3ca4f1937aba92ca53a05088ce8bcdd63e50921"}
Sep 19 04:48:11.692310 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.692221    2584 scope.go:117] "RemoveContainer" containerID="e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"
Sep 19 04:48:11.702097 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.702079    2584 scope.go:117] "RemoveContainer" containerID="a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"
Sep 19 04:48:11.710711 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.710692    2584 scope.go:117] "RemoveContainer" containerID="e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"
Sep 19 04:48:11.710977 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:48:11.710960    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8\": container with ID starting with e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8 not found: ID does not exist" containerID="e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"
Sep 19 04:48:11.711029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.710986    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8"} err="failed to get container status \"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8\": rpc error: code = NotFound desc = could not find container \"e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8\": container with ID starting with e9908b0e03e95225d3b55877aa272bf7de941e0c977794ec6c49f867052b83b8 not found: ID does not exist"
Sep 19 04:48:11.711029 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.711002    2584 scope.go:117] "RemoveContainer" containerID="a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"
Sep 19 04:48:11.711266 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:48:11.711247    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e\": container with ID starting with a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e not found: ID does not exist" containerID="a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"
Sep 19 04:48:11.711350 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.711290    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e"} err="failed to get container status \"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e\": rpc error: code = NotFound desc = could not find container \"a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e\": container with ID starting with a65170c0b313196a7f01662d1cdf654f4744d091927209f74efb97fe463ba37e not found: ID does not exist"
Sep 19 04:48:11.720530 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.720506    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:48:11.725025 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.725002    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-c1a7b6-openshift-default-794b897774-zgt4n"]
Sep 19 04:48:11.967827 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:11.967797    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" path="/var/lib/kubelet/pods/92780c9c-ebe5-4b93-9f63-f476faefdf79/volumes"
Sep 19 04:48:17.400955 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.400921    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:48:17.401470 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.401169    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" podUID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" containerName="maas-api" containerID="cri-o://7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a" gracePeriod=30
Sep 19 04:48:17.663054 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.662984    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:48:17.734401 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.734363    2584 generic.go:356] "Generic (PLEG): container finished" podID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" containerID="7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a" exitCode=0
Sep 19 04:48:17.734570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.734423    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"
Sep 19 04:48:17.734570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.734449    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" event={"ID":"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a","Type":"ContainerDied","Data":"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"}
Sep 19 04:48:17.734570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.734542    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l" event={"ID":"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a","Type":"ContainerDied","Data":"0105e4e1833441bc8e08a36563a35b35db6c918343490463b474e1737cd4ee83"}
Sep 19 04:48:17.734697 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.734572    2584 scope.go:117] "RemoveContainer" containerID="7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"
Sep 19 04:48:17.743906 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.743889    2584 scope.go:117] "RemoveContainer" containerID="7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"
Sep 19 04:48:17.744216 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:48:17.744198    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a\": container with ID starting with 7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a not found: ID does not exist" containerID="7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"
Sep 19 04:48:17.744268 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.744224    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a"} err="failed to get container status \"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a\": rpc error: code = NotFound desc = could not find container \"7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a\": container with ID starting with 7075b86e4703763007e24c446854c3b2851ac51a4fe1ee2e67c808af5c45166a not found: ID does not exist"
Sep 19 04:48:17.789858 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.789820    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca\") pod \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") "
Sep 19 04:48:17.790026 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.789894    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs\") pod \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") "
Sep 19 04:48:17.790026 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.789950    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") pod \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") "
Sep 19 04:48:17.790026 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.789987    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd6td\" (UniqueName: \"kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td\") pod \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\" (UID: \"edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a\") "
Sep 19 04:48:17.790365 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.790258    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" (UID: "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:48:17.794774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.794614    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" (UID: "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:48:17.794774 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.794722    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" (UID: "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:48:17.795680 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.795638    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td" (OuterVolumeSpecName: "kube-api-access-wd6td") pod "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" (UID: "edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a"). InnerVolumeSpecName "kube-api-access-wd6td". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:48:17.890733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.890700    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:17.890733 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.890726    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:17.890924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.890757    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd6td\" (UniqueName: \"kubernetes.io/projected/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-kube-api-access-wd6td\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:17.890924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:17.890766    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:48:18.050985 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:18.050950    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:48:18.057353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:18.057329    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-eac6c5-6c799b5579-pcs5l"]
Sep 19 04:48:19.968113 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:19.968030    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" path="/var/lib/kubelet/pods/edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a/volumes"
Sep 19 04:48:32.033100 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:32.033071    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:48:32.039392 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:32.039371    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:48:36.445938 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:36.445898    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:48:56.357989 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:48:56.357951    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:49:14.851568 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:49:14.851529    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:49:28.183940 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:49:28.183909    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:49:41.442306 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:49:41.442257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:50:00.260452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:50:00.260417    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:50:17.859109 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:50:17.859065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:50:44.174862 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:50:44.174826    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:50:59.576438 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:50:59.576364    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:51:32.232893 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:51:32.232860    2584 scope.go:117] "RemoveContainer" containerID="741f2faa8017aa072d49957e4e7d733e11678cd0a6af8a7d9bfda8709a2e3801"
Sep 19 04:51:39.086748 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:51:39.086704    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:52:00.261183 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:00.261143    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:52:14.772925 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:14.772876    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:52:29.555933 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:29.555898    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:52:45.060486 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:45.060452    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:52:59.778426 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778397    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:52:59.778930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778914    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:52:59.778975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778933    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:52:59.778975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778951    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:52:59.778975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778957    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:52:59.778975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778967    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" containerName="maas-api"
Sep 19 04:52:59.778975 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778973    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778986    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778991    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.778999    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec96bd1e-3821-45bf-8c82-564272773f0d" containerName="payload-pre-processing"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779005    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec96bd1e-3821-45bf-8c82-564272773f0d" containerName="payload-pre-processing"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779012    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779018    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779077    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="edad28b2-f3b3-42ac-ab40-1e0efbb0cb5a" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779084    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779091    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779097    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779102    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b6a05b-8b13-4cef-aa94-3bcc8e928482" containerName="maas-api"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779108    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779115    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec96bd1e-3821-45bf-8c82-564272773f0d" containerName="payload-pre-processing"
Sep 19 04:52:59.779125 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.779122    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea399f9c-6c9e-494b-af0f-6b865a80c0d9" containerName="maas-api"
Sep 19 04:52:59.782229 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.782210    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.784618 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.784591    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-618e62\""
Sep 19 04:52:59.784716 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.784677    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-618e62-dockercfg-jz6cq\""
Sep 19 04:52:59.799811 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.799783    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:52:59.871291 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.871253    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drsmp\" (UniqueName: \"kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.871453 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.871368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.972573 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.972544    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drsmp\" (UniqueName: \"kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.972743 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.972613    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.973259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.973239    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:52:59.981824 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:52:59.981800    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drsmp\" (UniqueName: \"kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp\") pod \"payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:53:00.092712 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:00.092683    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:53:00.368664 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:00.368637    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:53:00.370576 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:53:00.370549    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002ea5d6_9927_440c_a8de_7d3771982729.slice/crio-de7bf431ea0a590a7ab82e7c4087beaf9d49e7ba9ab0d813f7178646dc4bbb30 WatchSource:0}: Error finding container de7bf431ea0a590a7ab82e7c4087beaf9d49e7ba9ab0d813f7178646dc4bbb30: Status 404 returned error can't find the container with id de7bf431ea0a590a7ab82e7c4087beaf9d49e7ba9ab0d813f7178646dc4bbb30
Sep 19 04:53:01.185778 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:01.185738    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" event={"ID":"002ea5d6-9927-440c-a8de-7d3771982729","Type":"ContainerStarted","Data":"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"}
Sep 19 04:53:01.186211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:01.185806    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" event={"ID":"002ea5d6-9927-440c-a8de-7d3771982729","Type":"ContainerStarted","Data":"de7bf431ea0a590a7ab82e7c4087beaf9d49e7ba9ab0d813f7178646dc4bbb30"}
Sep 19 04:53:01.186211 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:01.185861    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:53:01.204924 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:01.204881    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" podStartSLOduration=2.204867692 podStartE2EDuration="2.204867692s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:52:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:53:01.203471537 +0000 UTC m=+2369.737452975" watchObservedRunningTime="2026-09-19 04:53:01.204867692 +0000 UTC m=+2369.738849144"
Sep 19 04:53:06.654861 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:06.654824    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:53:12.193449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:12.193412    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:53:32.072360 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:32.072334    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:53:32.080004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:32.079981    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:53:49.957111 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:53:49.957033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:54:12.951604 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:12.951567    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:54:28.236930 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.236897    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:54:28.237547 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.237530    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:54:28.237641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.237552    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="60cdfa91-d894-4550-90e0-a59f3033e9aa" containerName="istio-proxy"
Sep 19 04:54:28.237641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.237594    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:54:28.237641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.237603    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="92780c9c-ebe5-4b93-9f63-f476faefdf79" containerName="istio-proxy"
Sep 19 04:54:28.241259 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.241239    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.243854 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.243827    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-022574-serving-cert\""
Sep 19 04:54:28.253120 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.253096    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:54:28.300361 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.300333    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.300543 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.300423    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.300543 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.300474    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmjnt\" (UniqueName: \"kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.300654 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.300551    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.401796 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.401753    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.401977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.401838    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.401977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.401886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmjnt\" (UniqueName: \"kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.401977 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:54:28.401923    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-serving-cert: secret "maas-api-e2e-ipp-cleanup-022574-serving-cert" not found
Sep 19 04:54:28.401977 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.401934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.402112 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:54:28.402002    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls podName:4511bc25-51a0-4906-bd8d-716d3d6e95e8 nodeName:}" failed. No retries permitted until 2026-09-19 04:54:28.901979239 +0000 UTC m=+2457.435960655 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" (UID: "4511bc25-51a0-4906-bd8d-716d3d6e95e8") : secret "maas-api-e2e-ipp-cleanup-022574-serving-cert" not found
Sep 19 04:54:28.402641 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.402620    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.404578 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.404557    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.413653 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.413632    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmjnt\" (UniqueName: \"kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.906847 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.906805    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:28.909384 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:28.909360    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:29.152876 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:29.152840    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:29.432355 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:29.432326    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:54:29.434012 ip-10-0-139-253 kubenswrapper[2584]: W0919 04:54:29.433980    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4511bc25_51a0_4906_bd8d_716d3d6e95e8.slice/crio-530ca1da7d976eb9a3b8df055835730450ba481c0cddb2f9e9d17afc0a496ac2 WatchSource:0}: Error finding container 530ca1da7d976eb9a3b8df055835730450ba481c0cddb2f9e9d17afc0a496ac2: Status 404 returned error can't find the container with id 530ca1da7d976eb9a3b8df055835730450ba481c0cddb2f9e9d17afc0a496ac2
Sep 19 04:54:29.435429 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:29.435412    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 04:54:29.633529 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:29.633496    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" event={"ID":"4511bc25-51a0-4906-bd8d-716d3d6e95e8","Type":"ContainerStarted","Data":"530ca1da7d976eb9a3b8df055835730450ba481c0cddb2f9e9d17afc0a496ac2"}
Sep 19 04:54:30.640489 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:30.640450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" event={"ID":"4511bc25-51a0-4906-bd8d-716d3d6e95e8","Type":"ContainerStarted","Data":"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"}
Sep 19 04:54:30.640889 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:30.640564    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:30.661057 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:30.661005    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" podStartSLOduration=2.327409079 podStartE2EDuration="2.660993053s" totalImagesPullingTime="333.583974ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 04:54:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 04:54:30.660719995 +0000 UTC m=+2459.194701432" watchObservedRunningTime="2026-09-19 04:54:30.660993053 +0000 UTC m=+2459.194974491"
Sep 19 04:54:36.651490 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:36.651465    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:54:36.957726 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:54:36.957641    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:55:06.129859 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.129827    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:55:06.130451 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.130086    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" podUID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" containerName="maas-api" containerID="cri-o://b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200" gracePeriod=30
Sep 19 04:55:06.386359 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.386292    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:55:06.475212 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475183    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca\") pod \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") "
Sep 19 04:55:06.475449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475237    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs\") pod \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") "
Sep 19 04:55:06.475449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475262    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") pod \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") "
Sep 19 04:55:06.475449 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475350    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qmjnt\" (UniqueName: \"kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt\") pod \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\" (UID: \"4511bc25-51a0-4906-bd8d-716d3d6e95e8\") "
Sep 19 04:55:06.475611 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475591    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4511bc25-51a0-4906-bd8d-716d3d6e95e8" (UID: "4511bc25-51a0-4906-bd8d-716d3d6e95e8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:55:06.475728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.475710    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4511bc25-51a0-4906-bd8d-716d3d6e95e8-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.477952 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.477927    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4511bc25-51a0-4906-bd8d-716d3d6e95e8" (UID: "4511bc25-51a0-4906-bd8d-716d3d6e95e8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:55:06.478064 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.477947    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4511bc25-51a0-4906-bd8d-716d3d6e95e8" (UID: "4511bc25-51a0-4906-bd8d-716d3d6e95e8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:55:06.478186 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.478164    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt" (OuterVolumeSpecName: "kube-api-access-qmjnt") pod "4511bc25-51a0-4906-bd8d-716d3d6e95e8" (UID: "4511bc25-51a0-4906-bd8d-716d3d6e95e8"). InnerVolumeSpecName "kube-api-access-qmjnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:55:06.577004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.576975    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.577004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.577001    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4511bc25-51a0-4906-bd8d-716d3d6e95e8-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.577004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.577011    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qmjnt\" (UniqueName: \"kubernetes.io/projected/4511bc25-51a0-4906-bd8d-716d3d6e95e8-kube-api-access-qmjnt\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:55:06.827968 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.827928    2584 generic.go:356] "Generic (PLEG): container finished" podID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" containerID="b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200" exitCode=0
Sep 19 04:55:06.828155 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.827979    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"
Sep 19 04:55:06.828155 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.827978    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" event={"ID":"4511bc25-51a0-4906-bd8d-716d3d6e95e8","Type":"ContainerDied","Data":"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"}
Sep 19 04:55:06.828155 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.828090    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94" event={"ID":"4511bc25-51a0-4906-bd8d-716d3d6e95e8","Type":"ContainerDied","Data":"530ca1da7d976eb9a3b8df055835730450ba481c0cddb2f9e9d17afc0a496ac2"}
Sep 19 04:55:06.828155 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.828118    2584 scope.go:117] "RemoveContainer" containerID="b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"
Sep 19 04:55:06.840517 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.840489    2584 scope.go:117] "RemoveContainer" containerID="b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"
Sep 19 04:55:06.841084 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:55:06.841053    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200\": container with ID starting with b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200 not found: ID does not exist" containerID="b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"
Sep 19 04:55:06.841195 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.841094    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200"} err="failed to get container status \"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200\": rpc error: code = NotFound desc = could not find container \"b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200\": container with ID starting with b9f3f0a34cf6cb5478b03a108ea02cf6288f06fc71f019caa871146ede44a200 not found: ID does not exist"
Sep 19 04:55:06.864676 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.864645    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:55:06.874754 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:06.874728    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-022574-5546dc4884-bxq94"]
Sep 19 04:55:07.967378 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:07.967345    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" path="/var/lib/kubelet/pods/4511bc25-51a0-4906-bd8d-716d3d6e95e8/volumes"
Sep 19 04:55:13.348580 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:13.348549    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:55:32.464413 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:32.464373    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:55:47.155450 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:55:47.155412    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:56:35.891871 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:35.891838    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:56:35.892345 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:35.892044    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" podUID="002ea5d6-9927-440c-a8de-7d3771982729" containerName="payload-pre-processing" containerID="cri-o://7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095" gracePeriod=30
Sep 19 04:56:36.152390 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.152326    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:56:36.214895 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.214198    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drsmp\" (UniqueName: \"kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp\") pod \"002ea5d6-9927-440c-a8de-7d3771982729\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") "
Sep 19 04:56:36.214895 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.214337    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume\") pod \"002ea5d6-9927-440c-a8de-7d3771982729\" (UID: \"002ea5d6-9927-440c-a8de-7d3771982729\") "
Sep 19 04:56:36.215551 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.215508    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "002ea5d6-9927-440c-a8de-7d3771982729" (UID: "002ea5d6-9927-440c-a8de-7d3771982729"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:56:36.221258 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.221222    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp" (OuterVolumeSpecName: "kube-api-access-drsmp") pod "002ea5d6-9927-440c-a8de-7d3771982729" (UID: "002ea5d6-9927-440c-a8de-7d3771982729"). InnerVolumeSpecName "kube-api-access-drsmp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:56:36.295394 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.295361    2584 generic.go:356] "Generic (PLEG): container finished" podID="002ea5d6-9927-440c-a8de-7d3771982729" containerID="7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095" exitCode=0
Sep 19 04:56:36.295570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.295403    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"
Sep 19 04:56:36.295570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.295422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" event={"ID":"002ea5d6-9927-440c-a8de-7d3771982729","Type":"ContainerDied","Data":"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"}
Sep 19 04:56:36.295570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.295484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b" event={"ID":"002ea5d6-9927-440c-a8de-7d3771982729","Type":"ContainerDied","Data":"de7bf431ea0a590a7ab82e7c4087beaf9d49e7ba9ab0d813f7178646dc4bbb30"}
Sep 19 04:56:36.295570 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.295513    2584 scope.go:117] "RemoveContainer" containerID="7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"
Sep 19 04:56:36.304927 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.304908    2584 scope.go:117] "RemoveContainer" containerID="7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"
Sep 19 04:56:36.305177 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:56:36.305159    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095\": container with ID starting with 7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095 not found: ID does not exist" containerID="7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"
Sep 19 04:56:36.305227 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.305188    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095"} err="failed to get container status \"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095\": rpc error: code = NotFound desc = could not find container \"7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095\": container with ID starting with 7b13c135441ccf5083a58240fbf7a28a485150532237ed401e0ea0a8f2d1d095 not found: ID does not exist"
Sep 19 04:56:36.315422 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.315399    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drsmp\" (UniqueName: \"kubernetes.io/projected/002ea5d6-9927-440c-a8de-7d3771982729-kube-api-access-drsmp\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.315422 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.315420    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/002ea5d6-9927-440c-a8de-7d3771982729-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:36.326412 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.326392    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:56:36.330356 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:36.330332    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-618e62-56795488d6-rz62b"]
Sep 19 04:56:37.967627 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:37.967589    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="002ea5d6-9927-440c-a8de-7d3771982729" path="/var/lib/kubelet/pods/002ea5d6-9927-440c-a8de-7d3771982729/volumes"
Sep 19 04:56:40.847130 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:40.847092    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:56:54.214035 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.213930    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:56:54.214613 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.214198    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" podUID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" containerName="maas-api" containerID="cri-o://1af2557711acea646b254e8c791b364b043379fd091133f9faf0f5db28ba1d26" gracePeriod=30
Sep 19 04:56:54.289201 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.289170    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:56:54.289492 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.289465    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" podUID="b426cfa2-5507-48d0-9750-342b9c8adda6" containerName="payload-pre-processing" containerID="cri-o://a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b" gracePeriod=30
Sep 19 04:56:54.398964 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.398937    2584 generic.go:356] "Generic (PLEG): container finished" podID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" containerID="1af2557711acea646b254e8c791b364b043379fd091133f9faf0f5db28ba1d26" exitCode=0
Sep 19 04:56:54.399076 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.399008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" event={"ID":"0aeb193c-df31-4e01-85f6-ad6b238cc9ef","Type":"ContainerDied","Data":"1af2557711acea646b254e8c791b364b043379fd091133f9faf0f5db28ba1d26"}
Sep 19 04:56:54.541576 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.541550    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:56:54.576473 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.576446    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:56:54.688446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688410    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") pod \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") "
Sep 19 04:56:54.688621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688486    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca\") pod \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") "
Sep 19 04:56:54.688621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688526    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cz4hz\" (UniqueName: \"kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz\") pod \"b426cfa2-5507-48d0-9750-342b9c8adda6\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") "
Sep 19 04:56:54.688621 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688567    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume\") pod \"b426cfa2-5507-48d0-9750-342b9c8adda6\" (UID: \"b426cfa2-5507-48d0-9750-342b9c8adda6\") "
Sep 19 04:56:54.688816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688652    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs\") pod \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") "
Sep 19 04:56:54.688816 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688682    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xkfxh\" (UniqueName: \"kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh\") pod \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\" (UID: \"0aeb193c-df31-4e01-85f6-ad6b238cc9ef\") "
Sep 19 04:56:54.688898 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.688816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0aeb193c-df31-4e01-85f6-ad6b238cc9ef" (UID: "0aeb193c-df31-4e01-85f6-ad6b238cc9ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:56:54.689048 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.689024    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b426cfa2-5507-48d0-9750-342b9c8adda6" (UID: "b426cfa2-5507-48d0-9750-342b9c8adda6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:56:54.689157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.689142    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.689406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.689159    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b426cfa2-5507-48d0-9750-342b9c8adda6-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.690871 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.690850    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz" (OuterVolumeSpecName: "kube-api-access-cz4hz") pod "b426cfa2-5507-48d0-9750-342b9c8adda6" (UID: "b426cfa2-5507-48d0-9750-342b9c8adda6"). InnerVolumeSpecName "kube-api-access-cz4hz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:56:54.690871 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.690860    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh" (OuterVolumeSpecName: "kube-api-access-xkfxh") pod "0aeb193c-df31-4e01-85f6-ad6b238cc9ef" (UID: "0aeb193c-df31-4e01-85f6-ad6b238cc9ef"). InnerVolumeSpecName "kube-api-access-xkfxh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:56:54.691218 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.691201    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0aeb193c-df31-4e01-85f6-ad6b238cc9ef" (UID: "0aeb193c-df31-4e01-85f6-ad6b238cc9ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:56:54.691313 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.691226    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0aeb193c-df31-4e01-85f6-ad6b238cc9ef" (UID: "0aeb193c-df31-4e01-85f6-ad6b238cc9ef"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 04:56:54.790205 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.790170    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cz4hz\" (UniqueName: \"kubernetes.io/projected/b426cfa2-5507-48d0-9750-342b9c8adda6-kube-api-access-cz4hz\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.790205 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.790203    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.790446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.790217    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xkfxh\" (UniqueName: \"kubernetes.io/projected/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-kube-api-access-xkfxh\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:54.790446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:54.790230    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0aeb193c-df31-4e01-85f6-ad6b238cc9ef-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:56:55.405756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.405724    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"
Sep 19 04:56:55.405756 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.405734    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk" event={"ID":"0aeb193c-df31-4e01-85f6-ad6b238cc9ef","Type":"ContainerDied","Data":"84fd67d7b42a7183041d1b4c115c928833af1795d1fa3366079b0026b2adc13e"}
Sep 19 04:56:55.406245 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.405790    2584 scope.go:117] "RemoveContainer" containerID="1af2557711acea646b254e8c791b364b043379fd091133f9faf0f5db28ba1d26"
Sep 19 04:56:55.407243 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.407220    2584 generic.go:356] "Generic (PLEG): container finished" podID="b426cfa2-5507-48d0-9750-342b9c8adda6" containerID="a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b" exitCode=0
Sep 19 04:56:55.407353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.407267    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"
Sep 19 04:56:55.407353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.407310    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" event={"ID":"b426cfa2-5507-48d0-9750-342b9c8adda6","Type":"ContainerDied","Data":"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"}
Sep 19 04:56:55.407454 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.407365    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4" event={"ID":"b426cfa2-5507-48d0-9750-342b9c8adda6","Type":"ContainerDied","Data":"392ee94b9807259e64dba7f5c243bc27f7c8ab3a52a3ff1d2404b2a675ad2287"}
Sep 19 04:56:55.414990 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.414973    2584 scope.go:117] "RemoveContainer" containerID="a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"
Sep 19 04:56:55.424424 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.424404    2584 scope.go:117] "RemoveContainer" containerID="a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"
Sep 19 04:56:55.424720 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:56:55.424701    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b\": container with ID starting with a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b not found: ID does not exist" containerID="a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"
Sep 19 04:56:55.424805 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.424728    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b"} err="failed to get container status \"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b\": rpc error: code = NotFound desc = could not find container \"a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b\": container with ID starting with a472e273083103571ebee0b3897104238c90d73bbba4f7a4d2dbb11c577c3d7b not found: ID does not exist"
Sep 19 04:56:55.432922 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.432897    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:56:55.437133 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.437110    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-561bb1-65c5555569-cm2kk"]
Sep 19 04:56:55.447989 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.447969    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:56:55.452588 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.452566    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-561bb1-8d984ff4b-jtsz4"]
Sep 19 04:56:55.967788 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.967752    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" path="/var/lib/kubelet/pods/0aeb193c-df31-4e01-85f6-ad6b238cc9ef/volumes"
Sep 19 04:56:55.968179 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:55.968163    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b426cfa2-5507-48d0-9750-342b9c8adda6" path="/var/lib/kubelet/pods/b426cfa2-5507-48d0-9750-342b9c8adda6/volumes"
Sep 19 04:56:58.762353 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:56:58.762318    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:57:01.458916 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:01.458883    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:57:01.459366 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:01.459099    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy" containerID="cri-o://016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3" gracePeriod=30
Sep 19 04:57:06.700101 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.700077    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:57:06.797384 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797358    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797414    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797565 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797447    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797644 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797602    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797691 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797663    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797699    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data" (OuterVolumeSpecName: "istio-data") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:06.797728 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797706    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8wx7b\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797715    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:06.797810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797752    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.797810 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.798011 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797834    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy\") pod \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\" (UID: \"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8\") "
Sep 19 04:57:06.798461 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.797978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:06.798608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.798186    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.798608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.798501    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.798608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.798003    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:06.798608 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.798267    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:57:06.799780 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.799757    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token" (OuterVolumeSpecName: "istio-token") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:06.799941 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.799925    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:57:06.800009 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.799951    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b" (OuterVolumeSpecName: "kube-api-access-8wx7b") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "kube-api-access-8wx7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:06.800175 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.800156    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" (UID: "43a95d71-94ba-4e8c-b90a-b01fc7ce0db8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:06.899705 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899673    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899705 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899699    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899705 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899710    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8wx7b\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-kube-api-access-8wx7b\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899719    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899728    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899737    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:06.899931 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:06.899744    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:07.481384 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.481230    2584 generic.go:356] "Generic (PLEG): container finished" podID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerID="016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3" exitCode=0
Sep 19 04:57:07.481601 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.481392    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerDied","Data":"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"}
Sep 19 04:57:07.481601 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.481464    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"
Sep 19 04:57:07.481601 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.481479    2584 scope.go:117] "RemoveContainer" containerID="016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"
Sep 19 04:57:07.481601 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.481466    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8" event={"ID":"43a95d71-94ba-4e8c-b90a-b01fc7ce0db8","Type":"ContainerDied","Data":"89131032af923831b2a60bbae6730a184c00e00f59c3fd3cb33dfd89d0da78a8"}
Sep 19 04:57:07.491446 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.491429    2584 scope.go:117] "RemoveContainer" containerID="214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"
Sep 19 04:57:07.500048 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.500031    2584 scope.go:117] "RemoveContainer" containerID="016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"
Sep 19 04:57:07.500328 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:57:07.500305    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3\": container with ID starting with 016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3 not found: ID does not exist" containerID="016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"
Sep 19 04:57:07.500415 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.500341    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3"} err="failed to get container status \"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3\": rpc error: code = NotFound desc = could not find container \"016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3\": container with ID starting with 016412698af9ebb341450631e350a4d790fad1015f314208bcee1616c83188d3 not found: ID does not exist"
Sep 19 04:57:07.500415 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.500364    2584 scope.go:117] "RemoveContainer" containerID="214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"
Sep 19 04:57:07.500625 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:57:07.500606    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d\": container with ID starting with 214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d not found: ID does not exist" containerID="214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"
Sep 19 04:57:07.500669 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.500631    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d"} err="failed to get container status \"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d\": rpc error: code = NotFound desc = could not find container \"214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d\": container with ID starting with 214ee0a46538a6c97f97cc144c9ff01a086dd6e088836c135b78c71cf9899b5d not found: ID does not exist"
Sep 19 04:57:07.504839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.504816    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:57:07.510894 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.510871    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-561bb1-openshift-default-54ddf856c8-zqzv8"]
Sep 19 04:57:07.967361 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:07.967331    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" path="/var/lib/kubelet/pods/43a95d71-94ba-4e8c-b90a-b01fc7ce0db8/volumes"
Sep 19 04:57:12.469122 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.469087    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:57:12.469642 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.469361    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" podUID="0a70474a-0831-4db7-8fc5-285186029ccf" containerName="payload-processing" containerID="cri-o://4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee" gracePeriod=30
Sep 19 04:57:12.726594 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.726540    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:57:12.852452 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.852421    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vx6z8\" (UniqueName: \"kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8\") pod \"0a70474a-0831-4db7-8fc5-285186029ccf\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") "
Sep 19 04:57:12.852648 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.852485    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume\") pod \"0a70474a-0831-4db7-8fc5-285186029ccf\" (UID: \"0a70474a-0831-4db7-8fc5-285186029ccf\") "
Sep 19 04:57:12.852841 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.852816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0a70474a-0831-4db7-8fc5-285186029ccf" (UID: "0a70474a-0831-4db7-8fc5-285186029ccf"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:57:12.854794 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.854772    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8" (OuterVolumeSpecName: "kube-api-access-vx6z8") pod "0a70474a-0831-4db7-8fc5-285186029ccf" (UID: "0a70474a-0831-4db7-8fc5-285186029ccf"). InnerVolumeSpecName "kube-api-access-vx6z8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:12.953839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.953801    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vx6z8\" (UniqueName: \"kubernetes.io/projected/0a70474a-0831-4db7-8fc5-285186029ccf-kube-api-access-vx6z8\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:12.953839 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:12.953834    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0a70474a-0831-4db7-8fc5-285186029ccf-plugins-config-volume\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:13.513943 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.513905    2584 generic.go:356] "Generic (PLEG): container finished" podID="0a70474a-0831-4db7-8fc5-285186029ccf" containerID="4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee" exitCode=0
Sep 19 04:57:13.514387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.513966    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"
Sep 19 04:57:13.514387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.513990    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" event={"ID":"0a70474a-0831-4db7-8fc5-285186029ccf","Type":"ContainerDied","Data":"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"}
Sep 19 04:57:13.514387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.514069    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z" event={"ID":"0a70474a-0831-4db7-8fc5-285186029ccf","Type":"ContainerDied","Data":"9ea7c20b5e7c965fac5ec928c1dc9d864e70b3bf37397a06bc242a5a99af84b1"}
Sep 19 04:57:13.514387 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.514091    2584 scope.go:117] "RemoveContainer" containerID="4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"
Sep 19 04:57:13.522984 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.522965    2584 scope.go:117] "RemoveContainer" containerID="4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"
Sep 19 04:57:13.523232 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:57:13.523213    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee\": container with ID starting with 4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee not found: ID does not exist" containerID="4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"
Sep 19 04:57:13.523322 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.523240    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee"} err="failed to get container status \"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee\": rpc error: code = NotFound desc = could not find container \"4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee\": container with ID starting with 4167b544958d48afe4d4b93873a4c79b93255b9d344fead622fe498a16c8d6ee not found: ID does not exist"
Sep 19 04:57:13.536504 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.536481    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:57:13.539000 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.538979    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8bbcca-5bbd98c5-dcc2z"]
Sep 19 04:57:13.967546 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:13.967501    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a70474a-0831-4db7-8fc5-285186029ccf" path="/var/lib/kubelet/pods/0a70474a-0831-4db7-8fc5-285186029ccf/volumes"
Sep 19 04:57:16.649004 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:16.648974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:57:19.872236 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:19.872149    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:57:19.874732 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:19.872379    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy" containerID="cri-o://cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc" gracePeriod=30
Sep 19 04:57:25.110545 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.110516    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:57:25.171434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171344    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171434 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171423    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171458    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171496    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171520    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171623    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171657    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171720    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7jpw\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw\") pod \"e251a177-8916-41c8-afce-7ba4dcdb3523\" (UID: \"e251a177-8916-41c8-afce-7ba4dcdb3523\") "
Sep 19 04:57:25.171814 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171773    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:25.172192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.171887    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data" (OuterVolumeSpecName: "istio-data") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:25.172192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.172131    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-data\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.172192 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.172152    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.172385 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.172194    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:25.172385 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.172302    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 04:57:25.172494 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.172382    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:25.173740 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.173712    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 19 04:57:25.173874 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.173856    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 19 04:57:25.174406 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.174381    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token" (OuterVolumeSpecName: "istio-token") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:25.174498 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.174406    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw" (OuterVolumeSpecName: "kube-api-access-q7jpw") pod "e251a177-8916-41c8-afce-7ba4dcdb3523" (UID: "e251a177-8916-41c8-afce-7ba4dcdb3523"). InnerVolumeSpecName "kube-api-access-q7jpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 04:57:25.272665 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272632    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-credential-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272665 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272660    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7jpw\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-kube-api-access-q7jpw\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272665 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272670    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-podinfo\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272678    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-token\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272686    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-workload-socket\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272695    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e251a177-8916-41c8-afce-7ba4dcdb3523-istiod-ca-cert\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.272902 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.272702    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e251a177-8916-41c8-afce-7ba4dcdb3523-istio-envoy\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 04:57:25.573354 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.573318    2584 generic.go:356] "Generic (PLEG): container finished" podID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerID="cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc" exitCode=0
Sep 19 04:57:25.573544 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.573368    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"
Sep 19 04:57:25.573544 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.573397    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerDied","Data":"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"}
Sep 19 04:57:25.573544 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.573450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb" event={"ID":"e251a177-8916-41c8-afce-7ba4dcdb3523","Type":"ContainerDied","Data":"f34d42d11a8ccbdb9b413047f36ac79e793cf1e1c47f17428462f9429c99fc1c"}
Sep 19 04:57:25.573544 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.573472    2584 scope.go:117] "RemoveContainer" containerID="cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"
Sep 19 04:57:25.585620 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.585600    2584 scope.go:117] "RemoveContainer" containerID="875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"
Sep 19 04:57:25.594590 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.594573    2584 scope.go:117] "RemoveContainer" containerID="cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"
Sep 19 04:57:25.594836 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:57:25.594809    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc\": container with ID starting with cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc not found: ID does not exist" containerID="cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"
Sep 19 04:57:25.594950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.594844    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc"} err="failed to get container status \"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc\": rpc error: code = NotFound desc = could not find container \"cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc\": container with ID starting with cf30eccecd38443dd21f29fe79d1961e2e6ea3b95c27b1a4f90513d42fa000fc not found: ID does not exist"
Sep 19 04:57:25.594950 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.594865    2584 scope.go:117] "RemoveContainer" containerID="875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"
Sep 19 04:57:25.595115 ip-10-0-139-253 kubenswrapper[2584]: E0919 04:57:25.595099    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632\": container with ID starting with 875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632 not found: ID does not exist" containerID="875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"
Sep 19 04:57:25.595157 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.595121    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632"} err="failed to get container status \"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632\": rpc error: code = NotFound desc = could not find container \"875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632\": container with ID starting with 875a1374cc3aee3d66afc39a5ae8c8e5ca448debeada102410cada67d888d632 not found: ID does not exist"
Sep 19 04:57:25.603398 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.603378    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:57:25.608000 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.607979    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-8bbcca-openshift-default-75cc686bd4-ljflb"]
Sep 19 04:57:25.966999 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:25.966903    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" path="/var/lib/kubelet/pods/e251a177-8916-41c8-afce-7ba4dcdb3523/volumes"
Sep 19 04:57:29.248995 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:57:29.248959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:58:32.108960 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:58:32.108932    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:58:32.116383 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:58:32.116362    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 04:58:45.454213 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:58:45.454176    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:59:32.450405 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:59:32.450369    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:59:45.261558 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:59:45.261519    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 04:59:58.861501 ip-10-0-139-253 kubenswrapper[2584]: I0919 04:59:58.861420    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:00:19.559889 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:00:19.559852    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:01:51.882239 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:01:51.882202    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:02:04.758084 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:02:04.758049    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:02:17.058534 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:02:17.058496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:02:31.188022 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:02:31.187979    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:02:43.658718 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:02:43.658682    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:03:05.155214 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:05.155137    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:03:20.643031 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:20.642993    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:03:30.874318 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874265    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:30.874675 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874642    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" containerName="maas-api"
Sep 19 05:03:30.874675 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874653    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" containerName="maas-api"
Sep 19 05:03:30.874675 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874662    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a70474a-0831-4db7-8fc5-285186029ccf" containerName="payload-processing"
Sep 19 05:03:30.874675 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874667    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a70474a-0831-4db7-8fc5-285186029ccf" containerName="payload-processing"
Sep 19 05:03:30.874675 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874676    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874681    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874694    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" containerName="maas-api"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874699    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" containerName="maas-api"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874708    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874713    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874718    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="002ea5d6-9927-440c-a8de-7d3771982729" containerName="payload-pre-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874723    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="002ea5d6-9927-440c-a8de-7d3771982729" containerName="payload-pre-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874729    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b426cfa2-5507-48d0-9750-342b9c8adda6" containerName="payload-pre-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874734    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b426cfa2-5507-48d0-9750-342b9c8adda6" containerName="payload-pre-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874741    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874746    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874754    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874759    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874813    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0aeb193c-df31-4e01-85f6-ad6b238cc9ef" containerName="maas-api"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874821    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874827    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="002ea5d6-9927-440c-a8de-7d3771982729" containerName="payload-pre-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874834    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874840    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e251a177-8916-41c8-afce-7ba4dcdb3523" containerName="istio-proxy"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874846    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a70474a-0831-4db7-8fc5-285186029ccf" containerName="payload-processing"
Sep 19 05:03:30.874845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874850    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b426cfa2-5507-48d0-9750-342b9c8adda6" containerName="payload-pre-processing"
Sep 19 05:03:30.875487 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874855    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4511bc25-51a0-4906-bd8d-716d3d6e95e8" containerName="maas-api"
Sep 19 05:03:30.875487 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.874861    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="43a95d71-94ba-4e8c-b90a-b01fc7ce0db8" containerName="istio-proxy"
Sep 19 05:03:30.878037 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.878020    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:30.883415 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.883385    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 19 05:03:30.883530 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.883463    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-7pswq\""
Sep 19 05:03:30.883530 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.883474    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 19 05:03:30.897828 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.897805    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:30.946016 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.945985    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:30.946177 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.946023    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9cfg\" (UniqueName: \"kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:30.946177 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.946052    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:30.946177 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:30.946098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.047093 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.047058    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.047248 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.047101    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.047248 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.047151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.047248 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.047181    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9cfg\" (UniqueName: \"kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.047829 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.047803    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.049728 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.049703    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.049845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.049789    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.057298 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.057256    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9cfg\" (UniqueName: \"kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg\") pod \"maas-api-68cb6dd889-pfn4h\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") " pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.188844 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.188752    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:31.464351 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.464229    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:31.466652 ip-10-0-139-253 kubenswrapper[2584]: W0919 05:03:31.466616    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4450b0f0_b214_4d13_b78f_2134dfed843d.slice/crio-8079805ca42cc9e2bc2cb5a07304248cb57a955431f37101d7b3b3b77f77a448 WatchSource:0}: Error finding container 8079805ca42cc9e2bc2cb5a07304248cb57a955431f37101d7b3b3b77f77a448: Status 404 returned error can't find the container with id 8079805ca42cc9e2bc2cb5a07304248cb57a955431f37101d7b3b3b77f77a448
Sep 19 05:03:31.468061 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:31.468044    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 19 05:03:32.139147 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.139071    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 05:03:32.154202 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.154180    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 05:03:32.253081 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.253044    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:03:32.336940 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.336906    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" event={"ID":"4450b0f0-b214-4d13-b78f-2134dfed843d","Type":"ContainerStarted","Data":"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"}
Sep 19 05:03:32.337101 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.336961    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" event={"ID":"4450b0f0-b214-4d13-b78f-2134dfed843d","Type":"ContainerStarted","Data":"8079805ca42cc9e2bc2cb5a07304248cb57a955431f37101d7b3b3b77f77a448"}
Sep 19 05:03:32.337101 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.337000    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:32.359969 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:32.359915    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" podStartSLOduration=1.9896394530000001 podStartE2EDuration="2.359896168s" totalImagesPullingTime="370.256715ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 05:03:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 05:03:32.358032653 +0000 UTC m=+3000.892014093" watchObservedRunningTime="2026-09-19 05:03:32.359896168 +0000 UTC m=+3000.893877608"
Sep 19 05:03:38.347808 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.347778    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:38.824899 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.824851    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"]
Sep 19 05:03:38.828327 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.828310    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:38.839174 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.839147    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"]
Sep 19 05:03:38.916431 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.916393    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-metrics-certs\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:38.916603 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.916435    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-openshift-service-ca\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:38.916603 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.916559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx24v\" (UniqueName: \"kubernetes.io/projected/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-kube-api-access-tx24v\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:38.916603 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:38.916596    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-maas-api-tls\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.017982 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.017941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx24v\" (UniqueName: \"kubernetes.io/projected/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-kube-api-access-tx24v\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.018202 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.017995    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-maas-api-tls\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.018202 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.018134    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-metrics-certs\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.018202 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.018191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-openshift-service-ca\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.018850 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.018829    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-openshift-service-ca\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.020666 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.020640    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-metrics-certs\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.020755 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.020685    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-maas-api-tls\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.027845 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.027824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx24v\" (UniqueName: \"kubernetes.io/projected/bbea84d5-5f0a-427c-b96c-8946d1fa9fea-kube-api-access-tx24v\") pod \"maas-api-d47c7cd7c-qwxph\" (UID: \"bbea84d5-5f0a-427c-b96c-8946d1fa9fea\") " pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.138709 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.138603    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:39.413710 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:39.413685    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"]
Sep 19 05:03:39.416240 ip-10-0-139-253 kubenswrapper[2584]: W0919 05:03:39.416209    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbea84d5_5f0a_427c_b96c_8946d1fa9fea.slice/crio-7d7fcbf221c1591b2fe7bf1bb4d1e944961702bcecc85b3956c6021593b783ed WatchSource:0}: Error finding container 7d7fcbf221c1591b2fe7bf1bb4d1e944961702bcecc85b3956c6021593b783ed: Status 404 returned error can't find the container with id 7d7fcbf221c1591b2fe7bf1bb4d1e944961702bcecc85b3956c6021593b783ed
Sep 19 05:03:40.377627 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:40.377588    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph" event={"ID":"bbea84d5-5f0a-427c-b96c-8946d1fa9fea","Type":"ContainerStarted","Data":"12fb33e4fe18cf777c582a20c20ab69dc148b64376a10bbff23cdc63ddb8185c"}
Sep 19 05:03:40.377821 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:40.377642    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph" event={"ID":"bbea84d5-5f0a-427c-b96c-8946d1fa9fea","Type":"ContainerStarted","Data":"7d7fcbf221c1591b2fe7bf1bb4d1e944961702bcecc85b3956c6021593b783ed"}
Sep 19 05:03:40.377821 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:40.377696    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:40.399539 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:40.399478    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph" podStartSLOduration=2.073537714 podStartE2EDuration="2.399463459s" totalImagesPullingTime="325.925745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-19 05:03:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 05:03:40.397452168 +0000 UTC m=+3008.931433609" watchObservedRunningTime="2026-09-19 05:03:40.399463459 +0000 UTC m=+3008.933444900"
Sep 19 05:03:46.388367 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.388333    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d47c7cd7c-qwxph"
Sep 19 05:03:46.441968 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.441936    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:46.442158 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.442139    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" podUID="4450b0f0-b214-4d13-b78f-2134dfed843d" containerName="maas-api" containerID="cri-o://74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24" gracePeriod=30
Sep 19 05:03:46.694135 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.694112    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:46.792425 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.792393    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9cfg\" (UniqueName: \"kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg\") pod \"4450b0f0-b214-4d13-b78f-2134dfed843d\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") "
Sep 19 05:03:46.792425 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.792429    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs\") pod \"4450b0f0-b214-4d13-b78f-2134dfed843d\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") "
Sep 19 05:03:46.792643 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.792493    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca\") pod \"4450b0f0-b214-4d13-b78f-2134dfed843d\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") "
Sep 19 05:03:46.792643 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.792530    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls\") pod \"4450b0f0-b214-4d13-b78f-2134dfed843d\" (UID: \"4450b0f0-b214-4d13-b78f-2134dfed843d\") "
Sep 19 05:03:46.792880 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.792853    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4450b0f0-b214-4d13-b78f-2134dfed843d" (UID: "4450b0f0-b214-4d13-b78f-2134dfed843d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 19 05:03:46.794683 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.794655    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg" (OuterVolumeSpecName: "kube-api-access-j9cfg") pod "4450b0f0-b214-4d13-b78f-2134dfed843d" (UID: "4450b0f0-b214-4d13-b78f-2134dfed843d"). InnerVolumeSpecName "kube-api-access-j9cfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 19 05:03:46.794795 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.794709    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "4450b0f0-b214-4d13-b78f-2134dfed843d" (UID: "4450b0f0-b214-4d13-b78f-2134dfed843d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 05:03:46.794795 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.794775    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4450b0f0-b214-4d13-b78f-2134dfed843d" (UID: "4450b0f0-b214-4d13-b78f-2134dfed843d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 19 05:03:46.893460 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.893424    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4450b0f0-b214-4d13-b78f-2134dfed843d-openshift-service-ca\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 05:03:46.893460 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.893456    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-maas-api-tls\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 05:03:46.893460 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.893465    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9cfg\" (UniqueName: \"kubernetes.io/projected/4450b0f0-b214-4d13-b78f-2134dfed843d-kube-api-access-j9cfg\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 05:03:46.893697 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:46.893475    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4450b0f0-b214-4d13-b78f-2134dfed843d-metrics-certs\") on node \"ip-10-0-139-253.ec2.internal\" DevicePath \"\""
Sep 19 05:03:47.412149 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.412108    2584 generic.go:356] "Generic (PLEG): container finished" podID="4450b0f0-b214-4d13-b78f-2134dfed843d" containerID="74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24" exitCode=0
Sep 19 05:03:47.412668 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.412158    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"
Sep 19 05:03:47.412668 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.412172    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" event={"ID":"4450b0f0-b214-4d13-b78f-2134dfed843d","Type":"ContainerDied","Data":"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"}
Sep 19 05:03:47.412668 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.412220    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h" event={"ID":"4450b0f0-b214-4d13-b78f-2134dfed843d","Type":"ContainerDied","Data":"8079805ca42cc9e2bc2cb5a07304248cb57a955431f37101d7b3b3b77f77a448"}
Sep 19 05:03:47.412668 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.412243    2584 scope.go:117] "RemoveContainer" containerID="74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"
Sep 19 05:03:47.421643 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.421625    2584 scope.go:117] "RemoveContainer" containerID="74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"
Sep 19 05:03:47.421904 ip-10-0-139-253 kubenswrapper[2584]: E0919 05:03:47.421887    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24\": container with ID starting with 74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24 not found: ID does not exist" containerID="74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"
Sep 19 05:03:47.421957 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.421910    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24"} err="failed to get container status \"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24\": rpc error: code = NotFound desc = could not find container \"74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24\": container with ID starting with 74b28c7f6452242f5fbcb2e4ee427473803826cdf12763fc73a541b6baca1f24 not found: ID does not exist"
Sep 19 05:03:47.443633 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.443613    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:47.451032 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.451013    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-68cb6dd889-pfn4h"]
Sep 19 05:03:47.967481 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:47.967442    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4450b0f0-b214-4d13-b78f-2134dfed843d" path="/var/lib/kubelet/pods/4450b0f0-b214-4d13-b78f-2134dfed843d/volumes"
Sep 19 05:03:48.048767 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:48.048734    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:03:56.676969 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:03:56.676923    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:04:08.945786 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:08.945743    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:04:15.758185 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:15.758149    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-nf7j6"]
Sep 19 05:04:23.141954 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:23.141927    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-rmmc8_ef0d23b8-e700-441e-8aa4-681420b0f32c/manager/0.log"
Sep 19 05:04:24.230057 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:24.230030    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d47c7cd7c-qwxph_bbea84d5-5f0a-427c-b96c-8946d1fa9fea/maas-api/0.log"
Sep 19 05:04:24.556033 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:24.556007    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-g6pzf_99c874bf-e7e7-4eb8-8869-1db918cbdb74/postgres/0.log"
Sep 19 05:04:25.738787 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:25.738759    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-spj2r_64159ef5-3911-474f-b33b-9d04df17f28a/kuadrant-console-plugin/0.log"
Sep 19 05:04:25.997152 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:25.997081    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nf7j6_bb40659b-b16b-47af-86e0-5630ba20859f/limitador/0.log"
Sep 19 05:04:26.599086 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:26.599062    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dwnc4_32098fc4-3b74-40d5-8e34-5319105945ae/discovery/0.log"
Sep 19 05:04:26.836719 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:26.836694    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-xzqlq_54897523-3257-42b3-91c9-9ec0a2d96a54/kube-auth-proxy/0.log"
Sep 19 05:04:27.783782 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:27.783743    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-5fc5ddd44f-hrv4q_39084546-7de1-4c9e-b487-bedb0974c329/main/0.log"
Sep 19 05:04:28.121258 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:28.121232    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-5bccb7bbf7-6s44n_5948e9a6-49e4-4a0a-8447-b857525d01cf/main/0.log"
Sep 19 05:04:28.235772 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:28.235739    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-c68ddfgf9pj_dd01453a-f013-4fec-be91-3e4cad5e9112/main/0.log"
Sep 19 05:04:37.323127 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:37.323101    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-pp4mx_f88126a7-6010-4997-a008-a1fabdb0e621/global-pull-secret-syncer/0.log"
Sep 19 05:04:37.450458 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:37.450430    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qkpht_7d8ebb6d-2838-49af-9268-e7a000674506/konnectivity-agent/0.log"
Sep 19 05:04:37.586594 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:37.586529    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-253.ec2.internal_bae3474ce280cf20dc08552c2fd617f9/haproxy/0.log"
Sep 19 05:04:42.681199 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:42.681172    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-spj2r_64159ef5-3911-474f-b33b-9d04df17f28a/kuadrant-console-plugin/0.log"
Sep 19 05:04:42.811751 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:42.811721    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-nf7j6_bb40659b-b16b-47af-86e0-5630ba20859f/limitador/0.log"
Sep 19 05:04:44.447421 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.447391    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/alertmanager/0.log"
Sep 19 05:04:44.477694 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.477665    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/config-reloader/0.log"
Sep 19 05:04:44.501408 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.501388    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/kube-rbac-proxy-web/0.log"
Sep 19 05:04:44.538036 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.538015    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/kube-rbac-proxy/0.log"
Sep 19 05:04:44.586258 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.586237    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/kube-rbac-proxy-metric/0.log"
Sep 19 05:04:44.618315 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.618294    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/prom-label-proxy/0.log"
Sep 19 05:04:44.642647 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.642628    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_018ae69a-33cf-4d9c-974a-b5ab20049090/init-config-reloader/0.log"
Sep 19 05:04:44.795887 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.795859    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6656fb7dd-kg22k_e7dfdc0f-25c7-4b91-8a1c-fdcd02dded81/metrics-server/0.log"
Sep 19 05:04:44.828833 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:44.828814    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5984459ff8-vh7wj_cbe34b2b-5afc-4d89-8417-59d99913db2e/monitoring-plugin/0.log"
Sep 19 05:04:45.043597 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.043566    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/node-exporter/0.log"
Sep 19 05:04:45.075331 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.075260    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/kube-rbac-proxy/0.log"
Sep 19 05:04:45.098104 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.098083    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s8z4k_d392229c-114d-4305-b0bf-d095cfd28235/init-textfile/0.log"
Sep 19 05:04:45.447854 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.447829    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4z2d2_9a79bfb2-4ab1-4332-8230-e725f7430454/prometheus-operator/0.log"
Sep 19 05:04:45.475623 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.475594    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7bd5d56d6-4z2d2_9a79bfb2-4ab1-4332-8230-e725f7430454/kube-rbac-proxy/0.log"
Sep 19 05:04:45.538635 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.538613    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/telemeter-client/0.log"
Sep 19 05:04:45.569773 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.569752    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/reload/0.log"
Sep 19 05:04:45.593586 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.593565    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76fc478fff-n8pw8_889131ec-82aa-48bd-96d0-9174bfc4a9e9/kube-rbac-proxy/0.log"
Sep 19 05:04:45.625778 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.625741    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/thanos-query/0.log"
Sep 19 05:04:45.649191 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.649171    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-web/0.log"
Sep 19 05:04:45.670067 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.670044    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy/0.log"
Sep 19 05:04:45.694000 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.693937    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/prom-label-proxy/0.log"
Sep 19 05:04:45.716328 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.716302    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-rules/0.log"
Sep 19 05:04:45.738289 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:45.738254    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-75877b7d76-7lp2n_63acd33e-c569-48bd-850e-781306631818/kube-rbac-proxy-metrics/0.log"
Sep 19 05:04:46.927484 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:46.927454    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6446c8d75d-5k9xj_d3b8c698-7c35-4cef-b894-7c7e9529e287/networking-console-plugin/0.log"
Sep 19 05:04:47.272726 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.272647    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"]
Sep 19 05:04:47.273030 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.273018    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4450b0f0-b214-4d13-b78f-2134dfed843d" containerName="maas-api"
Sep 19 05:04:47.273073 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.273032    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4450b0f0-b214-4d13-b78f-2134dfed843d" containerName="maas-api"
Sep 19 05:04:47.273111 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.273090    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4450b0f0-b214-4d13-b78f-2134dfed843d" containerName="maas-api"
Sep 19 05:04:47.276149 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.276128    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.278474 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.278455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zp5t8\"/\"kube-root-ca.crt\""
Sep 19 05:04:47.279158 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.279138    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zp5t8\"/\"openshift-service-ca.crt\""
Sep 19 05:04:47.279252 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.279143    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zp5t8\"/\"default-dockercfg-b5t6l\""
Sep 19 05:04:47.289096 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.289076    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"]
Sep 19 05:04:47.444156 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.444126    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-sys\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.444373 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.444259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-podres\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.444373 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.444311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbxb\" (UniqueName: \"kubernetes.io/projected/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-kube-api-access-wbbxb\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.444373 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.444334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-proc\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.444373 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.444349    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-lib-modules\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545717 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-sys\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545878 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545785    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-podres\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545878 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545808    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbxb\" (UniqueName: \"kubernetes.io/projected/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-kube-api-access-wbbxb\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545878 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545813    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-sys\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545878 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545824    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-proc\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.545878 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545868    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-proc\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.546045 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545866    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-lib-modules\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.546045 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545943    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-podres\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.546045 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.545956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-lib-modules\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.554037 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.554017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbxb\" (UniqueName: \"kubernetes.io/projected/6f897277-cd1e-43d8-8a7c-e79a98e3b87a-kube-api-access-wbbxb\") pod \"perf-node-gather-daemonset-f9t7p\" (UID: \"6f897277-cd1e-43d8-8a7c-e79a98e3b87a\") " pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.586057 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.586033    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:47.695972 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.695942    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/2.log"
Sep 19 05:04:47.699316 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.699295    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-fd4bb46c-zj8pr_8e563010-443f-431f-95a4-e94696381c84/console-operator/3.log"
Sep 19 05:04:47.858408 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:47.858328    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"]
Sep 19 05:04:47.861571 ip-10-0-139-253 kubenswrapper[2584]: W0919 05:04:47.861539    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6f897277_cd1e_43d8_8a7c_e79a98e3b87a.slice/crio-b43861c11b7ff0d2d06f7f1a674eb1e38899748582813fb4773ce983d0b6854f WatchSource:0}: Error finding container b43861c11b7ff0d2d06f7f1a674eb1e38899748582813fb4773ce983d0b6854f: Status 404 returned error can't find the container with id b43861c11b7ff0d2d06f7f1a674eb1e38899748582813fb4773ce983d0b6854f
Sep 19 05:04:48.702084 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:48.702046    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p" event={"ID":"6f897277-cd1e-43d8-8a7c-e79a98e3b87a","Type":"ContainerStarted","Data":"e1a8f2c32bdec2d6edd305b41a81da79427aa93a62b685c2a780dd135f0ceb51"}
Sep 19 05:04:48.702552 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:48.702098    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p" event={"ID":"6f897277-cd1e-43d8-8a7c-e79a98e3b87a","Type":"ContainerStarted","Data":"b43861c11b7ff0d2d06f7f1a674eb1e38899748582813fb4773ce983d0b6854f"}
Sep 19 05:04:48.702552 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:48.702137    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:48.718849 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:48.718791    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p" podStartSLOduration=1.718771297 podStartE2EDuration="1.718771297s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-19 05:04:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-19 05:04:48.717938696 +0000 UTC m=+3077.251920137" watchObservedRunningTime="2026-09-19 05:04:48.718771297 +0000 UTC m=+3077.252752736"
Sep 19 05:04:50.173628 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:50.173598    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lx2tb_637b5af8-6cff-4d78-8940-52349943c82f/dns/0.log"
Sep 19 05:04:50.194445 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:50.194422    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lx2tb_637b5af8-6cff-4d78-8940-52349943c82f/kube-rbac-proxy/0.log"
Sep 19 05:04:50.330319 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:50.330296    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nftcf_3ea72195-43ff-4484-886c-739fa5878e2e/dns-node-resolver/0.log"
Sep 19 05:04:50.985708 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:50.985678    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vmnnf_bc83c9f3-f699-4e99-8efb-b686472aee5e/node-ca/0.log"
Sep 19 05:04:52.487811 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:52.487780    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dwnc4_32098fc4-3b74-40d5-8e34-5319105945ae/discovery/0.log"
Sep 19 05:04:52.545157 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:52.545128    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-xzqlq_54897523-3257-42b3-91c9-9ec0a2d96a54/kube-auth-proxy/0.log"
Sep 19 05:04:53.745297 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:53.745248    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r4tvx_ece9e24c-990e-4be0-ba4f-b5180d777b82/serve-healthcheck-canary/0.log"
Sep 19 05:04:54.277005 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:54.276979    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2ksd_d5bf6c9b-1e27-4443-b4e4-557b3b78d70c/kube-rbac-proxy/0.log"
Sep 19 05:04:54.298419 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:54.298396    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2ksd_d5bf6c9b-1e27-4443-b4e4-557b3b78d70c/exporter/0.log"
Sep 19 05:04:54.319693 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:54.319671    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c2ksd_d5bf6c9b-1e27-4443-b4e4-557b3b78d70c/extractor/0.log"
Sep 19 05:04:54.718250 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:54.718226    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zp5t8/perf-node-gather-daemonset-f9t7p"
Sep 19 05:04:57.184995 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:57.184954    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-fc5f7b9db-jlptp_40512e0f-b114-4f30-b788-157f1a07391d/manager/0.log"
Sep 19 05:04:57.208173 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:57.208089    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-fc5f7b9db-jlptp_40512e0f-b114-4f30-b788-157f1a07391d/copy-manifests/0.log"
Sep 19 05:04:57.381432 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:57.381400    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dwnc4_32098fc4-3b74-40d5-8e34-5319105945ae/discovery/0.log"
Sep 19 05:04:57.417222 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:57.417200    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-xzqlq_54897523-3257-42b3-91c9-9ec0a2d96a54/kube-auth-proxy/0.log"
Sep 19 05:04:59.304679 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:59.304654    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-7645b9c6f5-rmmc8_ef0d23b8-e700-441e-8aa4-681420b0f32c/manager/0.log"
Sep 19 05:04:59.596601 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:59.596515    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-dwnc4_32098fc4-3b74-40d5-8e34-5319105945ae/discovery/0.log"
Sep 19 05:04:59.644381 ip-10-0-139-253 kubenswrapper[2584]: I0919 05:04:59.644351    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6644598669-xzqlq_54897523-3257-42b3-91c9-9ec0a2d96a54/kube-auth-proxy/0.log"