Sep 15 20:02:58.539956 ip-10-0-137-138 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Sep 15 20:02:58.539971 ip-10-0-137-138 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Sep 15 20:02:58.539981 ip-10-0-137-138 systemd[1]: kubelet.service: Failed with result 'resources'.
Sep 15 20:02:58.540193 ip-10-0-137-138 systemd[1]: Failed to start Kubernetes Kubelet.
Sep 15 20:03:08.788659 ip-10-0-137-138 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Sep 15 20:03:08.788675 ip-10-0-137-138 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot ad78150a128645889037856ac9d41f57 --
Sep 15 20:05:05.455362 ip-10-0-137-138 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 20:05:05.793010 ip-10-0-137-138 kubenswrapper[2554]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 20:05:05.793010 ip-10-0-137-138 kubenswrapper[2554]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 20:05:05.793010 ip-10-0-137-138 kubenswrapper[2554]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 20:05:05.793010 ip-10-0-137-138 kubenswrapper[2554]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 20:05:05.793010 ip-10-0-137-138 kubenswrapper[2554]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 20:05:05.795027 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.794907    2554 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 20:05:05.800194 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800167    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.800194 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800188    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.800194 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800193    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.800194 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800199    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800204    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800209    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800213    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800217    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800221    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800225    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800229    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800233    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800236    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800240    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800244    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800247    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800251    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800255    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800260    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800264    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800268    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800272    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800276    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.800459 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800280    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800284    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800288    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800292    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800295    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800299    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800303    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800307    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800312    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800317    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800321    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800325    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800329    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800335    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800340    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800345    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800350    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800354    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800359    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800363    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.801309 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800367    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800371    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800375    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800379    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800384    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800389    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800393    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800402    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800408    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800413    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800418    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800423    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800428    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800432    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800437    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800441    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800445    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800450    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800457    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.801812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800463    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800467    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800471    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800476    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800480    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800484    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800488    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800494    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800499    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800503    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800507    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800512    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800516    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800520    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800524    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800529    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800533    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800538    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800542    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800546    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.802568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800551    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800556    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800560    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800564    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800569    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800573    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800577    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800581    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800585    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800590    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800594    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800599    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800603    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800608    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800614    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800620    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.800625    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802666    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802679    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.803428 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802683    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802688    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802694    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802700    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802706    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802711    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802716    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802720    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802725    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802729    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802734    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802738    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802743    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802748    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802753    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802766    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802772    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802777    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802782    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802786    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.804253 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802791    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802796    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802801    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802805    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802810    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802815    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802819    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802824    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802828    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802832    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802837    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802841    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802845    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802849    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802853    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802857    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802862    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802866    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802870    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.805145 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802874    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802880    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802884    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802888    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802892    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802897    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802901    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802906    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802910    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802924    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802931    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802935    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802939    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802943    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802947    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802952    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802956    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802960    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802964    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.805967 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802969    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802973    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.802995    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803000    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803004    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803008    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803013    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803017    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803022    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803028    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803033    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803037    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803040    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803045    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803050    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803058    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803064    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803070    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803075    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803079    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.806581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803083    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803087    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803091    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803104    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803108    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803113    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803118    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803121    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803126    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803131    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803136    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803140    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803144    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803149    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803153    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803157    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803161    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803165    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803169    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803829    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.807209 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803838    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803845    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803851    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803856    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803860    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803865    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803869    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803873    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803877    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803882    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803886    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803890    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803896    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803901    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803905    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803910    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803914    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803919    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803923    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803927    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.807738 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803931    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803935    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803940    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803944    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803948    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803952    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803957    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803961    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803966    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803970    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803974    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.803996    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804000    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804006    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804011    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804015    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804019    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804024    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804028    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804032    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.808443 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804036    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804040    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804044    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804053    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804059    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804064    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804069    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804073    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804078    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804082    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804087    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804091    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804095    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804100    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804104    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804108    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804113    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804119    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804125    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804130    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.808972 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804134    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804139    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804144    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804148    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804152    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804158    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804162    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804166    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804170    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804174    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804178    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804182    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804188    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804195    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804200    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804207    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804212    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804217    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804222    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.809567 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804227    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804232    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804237    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804242    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804246    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804250    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804254    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804258    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804263    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804267    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804271    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804275    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804279    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804283    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804287    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804292    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804296    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804300    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.804305    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804431    2554 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 20:05:05.810109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804480    2554 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804493    2554 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804500    2554 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804506    2554 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804511    2554 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804519    2554 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804526    2554 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804532    2554 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804540    2554 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804545    2554 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804550    2554 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804556    2554 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804561    2554 flags.go:64] FLAG: --cgroup-root=""
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804565    2554 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804571    2554 flags.go:64] FLAG: --client-ca-file=""
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804581    2554 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804587    2554 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804593    2554 flags.go:64] FLAG: --cluster-domain=""
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804598    2554 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804603    2554 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804608    2554 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804614    2554 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804621    2554 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 20:05:05.810620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804626    2554 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804631    2554 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804636    2554 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804641    2554 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804646    2554 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804651    2554 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804656    2554 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804661    2554 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804668    2554 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804673    2554 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804678    2554 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804683    2554 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804688    2554 flags.go:64] FLAG: --enable-server="true"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804693    2554 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804701    2554 flags.go:64] FLAG: --event-burst="100"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804706    2554 flags.go:64] FLAG: --event-qps="50"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804711    2554 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804718    2554 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804723    2554 flags.go:64] FLAG: --eviction-hard=""
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804729    2554 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804734    2554 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804738    2554 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804744    2554 flags.go:64] FLAG: --eviction-soft=""
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804749    2554 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804754    2554 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 20:05:05.811209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804760    2554 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804764    2554 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804769    2554 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804774    2554 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804778    2554 flags.go:64] FLAG: --feature-gates=""
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804785    2554 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804791    2554 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804796    2554 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804801    2554 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804806    2554 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804811    2554 flags.go:64] FLAG: --help="false"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804816    2554 flags.go:64] FLAG: --hostname-override="ip-10-0-137-138.ec2.internal"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804821    2554 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804826    2554 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804831    2554 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804836    2554 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804842    2554 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804847    2554 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804852    2554 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804856    2554 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804861    2554 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804866    2554 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804871    2554 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804876    2554 flags.go:64] FLAG: --kube-reserved=""
Sep 15 20:05:05.811825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804883    2554 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804887    2554 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804892    2554 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804897    2554 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804901    2554 flags.go:64] FLAG: --lock-file=""
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804906    2554 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804911    2554 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804916    2554 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804925    2554 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804931    2554 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804936    2554 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804941    2554 flags.go:64] FLAG: --logging-format="text"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804946    2554 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804951    2554 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804956    2554 flags.go:64] FLAG: --manifest-url=""
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804961    2554 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804968    2554 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804973    2554 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.804996    2554 flags.go:64] FLAG: --max-pods="110"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805001    2554 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805006    2554 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805011    2554 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805016    2554 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805021    2554 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805025    2554 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 20:05:05.812515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805030    2554 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805042    2554 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805047    2554 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805052    2554 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805058    2554 flags.go:64] FLAG: --pod-cidr=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805062    2554 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805072    2554 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805079    2554 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805084    2554 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805089    2554 flags.go:64] FLAG: --port="10250"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805094    2554 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805110    2554 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e545644f36e31071"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805117    2554 flags.go:64] FLAG: --qos-reserved=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805122    2554 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805127    2554 flags.go:64] FLAG: --register-node="true"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805133    2554 flags.go:64] FLAG: --register-with-taints=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805139    2554 flags.go:64] FLAG: --registry-burst="10"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805152    2554 flags.go:64] FLAG: --registry-qps="5"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805157    2554 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805162    2554 flags.go:64] FLAG: --reserved-memory=""
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805168    2554 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805173    2554 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805178    2554 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805182    2554 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805187    2554 flags.go:64] FLAG: --runonce="false"
Sep 15 20:05:05.813318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805192    2554 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805197    2554 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805202    2554 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805207    2554 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805213    2554 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805219    2554 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805224    2554 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805229    2554 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805234    2554 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805239    2554 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805244    2554 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805249    2554 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805254    2554 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805258    2554 flags.go:64] FLAG: --system-cgroups=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805265    2554 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805275    2554 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805280    2554 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805284    2554 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805290    2554 flags.go:64] FLAG: --tls-min-version=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805295    2554 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805300    2554 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805305    2554 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805310    2554 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805315    2554 flags.go:64] FLAG: --v="2"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805321    2554 flags.go:64] FLAG: --version="false"
Sep 15 20:05:05.813941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805335    2554 flags.go:64] FLAG: --vmodule=""
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805342    2554 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.805348    2554 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805564    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805572    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805577    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805582    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805587    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805592    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805596    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805600    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805607    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805611    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805615    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805619    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805623    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805627    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805632    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805636    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805641    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.814579 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805645    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805651    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805655    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805659    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805666    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805673    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805678    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805682    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805688    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805692    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805697    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805702    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805706    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805711    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805717    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805722    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805726    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805731    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805736    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.815114 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805741    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805745    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805749    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805753    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805760    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805765    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805769    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805773    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805778    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805782    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805786    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805791    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805794    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805799    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805806    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805810    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805814    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805818    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805825    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.815594 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805830    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805843    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805848    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805853    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805857    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805862    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805866    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805871    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805876    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805881    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805885    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805890    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805894    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805898    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805904    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805910    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805915    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805922    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805926    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805931    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.816104 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805935    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805940    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805945    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805949    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805953    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805957    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805962    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805968    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805972    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805976    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.805998    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806002    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806006    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806010    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806014    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806019    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806023    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806027    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806032    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806036    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.816607 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806040    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806045    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806049    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.806053    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.806601    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.814469    2554 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.814489    2554 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.814509    2554 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.814516    2554 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814583    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814589    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814592    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814595    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814599    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814602    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.817211 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814604    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814607    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814610    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814613    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814616    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814618    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814621    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814624    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814627    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814630    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814632    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814635    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814637    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814640    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814643    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814645    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814648    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814651    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814653    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814656    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.817596 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814659    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814661    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814665    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814669    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814672    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814675    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814678    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814680    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814683    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814686    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814689    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814691    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814694    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814696    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814699    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814702    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814704    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814707    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814709    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814712    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.818112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814714    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814717    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814720    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814723    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814727    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814731    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814734    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814737    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814740    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814742    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814745    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814747    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814750    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814752    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814755    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814760    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814763    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814766    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814768    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.818611 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814771    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814774    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814776    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814779    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814782    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814784    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814787    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814790    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814793    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814795    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814798    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814801    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814804    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814806    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814809    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814812    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814815    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814817    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814820    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.819109 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814823    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814827    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814830    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814833    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814836    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814839    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814842    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814845    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814849    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814853    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814856    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814860    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814863    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814865    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.819576 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.814868    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.814874    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815026    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815032    2554 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815035    2554 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815038    2554 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815042    2554 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815045    2554 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815048    2554 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815050    2554 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815053    2554 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815056    2554 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815058    2554 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815061    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815064    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 20:05:05.819917 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815067    2554 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815069    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815072    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815074    2554 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815077    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815080    2554 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815082    2554 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815085    2554 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815089    2554 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815093    2554 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815096    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815099    2554 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815102    2554 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815105    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815108    2554 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815111    2554 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815114    2554 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815117    2554 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815120    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815123    2554 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 20:05:05.820367 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815126    2554 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815129    2554 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815132    2554 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815135    2554 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815139    2554 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815142    2554 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815145    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815149    2554 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815152    2554 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815155    2554 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815158    2554 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815161    2554 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815164    2554 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815167    2554 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815170    2554 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815173    2554 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815176    2554 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815179    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815182    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 20:05:05.820870 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815185    2554 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815187    2554 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815190    2554 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815193    2554 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815196    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815199    2554 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815201    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815204    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815207    2554 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815210    2554 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815213    2554 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815215    2554 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815218    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815221    2554 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815224    2554 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815226    2554 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815229    2554 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815232    2554 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815234    2554 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815237    2554 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 20:05:05.821348 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815239    2554 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815243    2554 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815246    2554 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815249    2554 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815251    2554 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815254    2554 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815257    2554 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815260    2554 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815262    2554 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815265    2554 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815268    2554 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815270    2554 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815273    2554 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815275    2554 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815278    2554 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815280    2554 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815283    2554 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815286    2554 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815289    2554 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815292    2554 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 20:05:05.821854 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815294    2554 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815297    2554 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815306    2554 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815309    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815312    2554 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815314    2554 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:05.815317    2554 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.815322    2554 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.815477    2554 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.817580    2554 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.818434    2554 server.go:1019] "Starting client certificate rotation"
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.818561    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.818616    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 20:05:05.822371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.820841    2554 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 20:05:05.822864 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.822832    2554 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 20:05:05.831874 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.831854    2554 log.go:25] "Validated CRI v1 runtime API"
Sep 15 20:05:05.834640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.834620    2554 log.go:25] "Validated CRI v1 image API"
Sep 15 20:05:05.836755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.836737    2554 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 20:05:05.838859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.838837    2554 fs.go:135] Filesystem UUIDs: map[16df9da9-2374-4190-a224-d393335553f2:/dev/nvme0n1p4 735b4a80-cf45-40cf-95ee-fad1f7b30c2c:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 15 20:05:05.838928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.838857    2554 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 20:05:05.844388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.844257    2554 manager.go:216] Machine: {Timestamp:2026-09-15 20:05:05.843090519 +0000 UTC m=+0.288049518 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101539 MemoryCapacity:33164468224 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26ce9249a3f0ef1efc07fbbb7abcfd SystemUUID:ec26ce92-49a3-f0ef-1efc-07fbbb7abcfd BootID:ad78150a-1286-4588-9037-856ac9d41f57 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:c6:70:8c:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:c6:70:8c:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3a:eb:93:17:89:60 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164468224 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 20:05:05.844388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.844380    2554 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 20:05:05.844503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.844478    2554 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 20:05:05.847265 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.847223    2554 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 20:05:05.847433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.847268    2554 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-138.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 20:05:05.848676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.848665    2554 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 20:05:05.848715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.848679    2554 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 20:05:05.848715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.848689    2554 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 20:05:05.849316 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.849304    2554 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 20:05:05.850702 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.850689    2554 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 20:05:05.852877 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.852845    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 20:05:05.854556 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854541    2554 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 20:05:05.854710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854700    2554 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 20:05:05.854749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854734    2554 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 20:05:05.854749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854746    2554 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 20:05:05.854809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854761    2554 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 20:05:05.854809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854771    2554 kubelet.go:398] "Adding apiserver pod source"
Sep 15 20:05:05.854809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.854780    2554 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 20:05:05.855219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.855206    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 20:05:05.855285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.855232    2554 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 20:05:05.857336 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.857315    2554 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 20:05:05.860043 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.860027    2554 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 20:05:05.860102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.860066    2554 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 20:05:05.861679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861667    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861683    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861690    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861695    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861704    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861709    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861727    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861735    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861750    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 20:05:05.861755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861756    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 20:05:05.862024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861765    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 20:05:05.862024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861770    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 20:05:05.862024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861826    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 20:05:05.862024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.861843    2554 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 20:05:05.865882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.865864    2554 server.go:1268] "Started kubelet"
Sep 15 20:05:05.865968 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.865945    2554 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 20:05:05.866581 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.866406    2554 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 20:05:05.866681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.866613    2554 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 20:05:05.866736 ip-10-0-137-138 systemd[1]: Started Kubernetes Kubelet.
Sep 15 20:05:05.870287 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.870259    2554 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 20:05:05.871450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.871428    2554 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 20:05:05.872877 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.872857    2554 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-138.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 20:05:05.873476 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.873449    2554 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 20:05:05.875019 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.874994    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 20:05:05.875082 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.875025    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 20:05:05.876082 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.875256    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-138.ec2.internal.18d5973ad3bb9367  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-138.ec2.internal,UID:ip-10-0-137-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-138.ec2.internal,},FirstTimestamp:2026-09-15 20:05:05.865823079 +0000 UTC m=+0.310782078,LastTimestamp:2026-09-15 20:05:05.865823079 +0000 UTC m=+0.310782078,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-138.ec2.internal,}"
Sep 15 20:05:05.877002 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.876973    2554 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 20:05:05.877464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.877449    2554 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 20:05:05.877618 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.877598    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:05.878061 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878039    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c2pnt"
Sep 15 20:05:05.878159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878102    2554 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 20:05:05.878159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878115    2554 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 20:05:05.878258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878225    2554 factory.go:55] Registering systemd factory
Sep 15 20:05:05.878258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878239    2554 factory.go:223] Registration of the systemd container factory successfully
Sep 15 20:05:05.878258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878246    2554 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 20:05:05.878258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878252    2554 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 20:05:05.878425 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878285    2554 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 20:05:05.878458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878442    2554 factory.go:153] Registering CRI-O factory
Sep 15 20:05:05.878458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878455    2554 factory.go:223] Registration of the crio container factory successfully
Sep 15 20:05:05.878526 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878513    2554 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 20:05:05.878562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878536    2554 factory.go:103] Registering Raw factory
Sep 15 20:05:05.878562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878549    2554 manager.go:1196] Started watching for new ooms in manager
Sep 15 20:05:05.879209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.878970    2554 manager.go:349] Starting recovery of all containers
Sep 15 20:05:05.885379 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.885352    2554 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 15 20:05:05.885563 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.885475    2554 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-138.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 15 20:05:05.887287 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.887260    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-c2pnt"
Sep 15 20:05:05.889992 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.889959    2554 manager.go:354] Recovery completed
Sep 15 20:05:05.896052 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.896039    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:05.900725 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.900707    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:05.900798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.900745    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:05.900798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.900763    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:05.901412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.901398    2554 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 20:05:05.901412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.901409    2554 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 20:05:05.901530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.901412    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:05.901530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.901426    2554 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 20:05:05.902312 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.902294    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:05.902376 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.902327    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:05.902376 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.902341    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:05.903379 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.903291    2554 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-138.ec2.internal.18d5973ad5d025bd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-138.ec2.internal,UID:ip-10-0-137-138.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-138.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-138.ec2.internal,},FirstTimestamp:2026-09-15 20:05:05.900725693 +0000 UTC m=+0.345684693,LastTimestamp:2026-09-15 20:05:05.900725693 +0000 UTC m=+0.345684693,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-138.ec2.internal,}"
Sep 15 20:05:05.903482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.903471    2554 policy_none.go:49] "None policy: Start"
Sep 15 20:05:05.903515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.903487    2554 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 20:05:05.903515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.903497    2554 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 20:05:05.905479 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.905465    2554 policy_none.go:47] "Start"
Sep 15 20:05:05.941634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.941609    2554 manager.go:337] "Starting Device Plugin manager"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.941650    2554 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.941660    2554 server.go:87] "Starting device plugin registration server"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.942078    2554 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.942092    2554 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.942228    2554 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.942317    2554 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:05.942327    2554 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.942947    2554 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 20:05:05.961519 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:05.943022    2554 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.015639 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.015596    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 20:05:06.016845 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.016820    2554 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 20:05:06.016951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.016890    2554 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 20:05:06.016951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.016925    2554 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 20:05:06.017067 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.016990    2554 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 20:05:06.019580 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.019557    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 20:05:06.042901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.042856    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:06.044174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.044093    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:06.044174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.044131    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:06.044174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.044146    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:06.044338 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.044178    2554 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.054261 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.054236    2554 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.054314 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.054267    2554 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-138.ec2.internal\": node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.071499 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.071469    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.117916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.117876    2554 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"]
Sep 15 20:05:06.118092 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.118002    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:06.119077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.119056    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:06.119181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.119086    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:06.119181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.119101    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:06.121458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.121444    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:06.121599 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.121584    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.121634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.121617    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:06.123666 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123652    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:06.123747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123680    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:06.123747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123691    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:06.123747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123658    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:06.123844 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123749    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:06.123844 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.123759    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:06.125953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.125936    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.126056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.125962    2554 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 20:05:06.128016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.128000    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 20:05:06.128109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.128030    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 20:05:06.128109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.128045    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeHasSufficientPID"
Sep 15 20:05:06.140599 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.140577    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-138.ec2.internal\" not found" node="ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.144783 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.144766    2554 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-138.ec2.internal\" not found" node="ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.172323 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.172294    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.180690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.180662    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.180750 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.180697    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.180750 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.180717    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.272677 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.272644    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.281083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281059    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.281138 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281087    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.281138 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281104    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.281203 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281148    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d5fe63d2e1dec62eab5d7d2258fa34d2-config\") pod \"kube-apiserver-proxy-ip-10-0-137-138.ec2.internal\" (UID: \"d5fe63d2e1dec62eab5d7d2258fa34d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.281235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281197    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.281235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.281212    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9d9c349dff749c2683923cdd68686644-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal\" (UID: \"9d9c349dff749c2683923cdd68686644\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.373033 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.372930    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.443515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.443487    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.448634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.448590    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:06.473798 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.473762    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.574404 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.574362    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.674941 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.674869    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.775458 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.775428    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.818938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.818909    2554 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 20:05:06.819399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.819069    2554 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 20:05:06.876496 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.876466    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:06.890884 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.890847    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 20:00:05 +0000 UTC" deadline="2028-04-28 12:00:15.66754325 +0000 UTC"
Sep 15 20:05:06.890884 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:06.890878    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14175h55m8.776668473s"
Sep 15 20:05:06.977142 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:06.977070    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:07.024809 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:07.024763    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5fe63d2e1dec62eab5d7d2258fa34d2.slice/crio-510bfb5e028fa4907b544af5030b626aface2afa5c0c90bb7c6fc491f5855513 WatchSource:0}: Error finding container 510bfb5e028fa4907b544af5030b626aface2afa5c0c90bb7c6fc491f5855513: Status 404 returned error can't find the container with id 510bfb5e028fa4907b544af5030b626aface2afa5c0c90bb7c6fc491f5855513
Sep 15 20:05:07.025076 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:07.025051    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9c349dff749c2683923cdd68686644.slice/crio-cea5d4b7369b0f72b1d7d7a9539d6f652e0b828c278d62d305fe520537ff42ba WatchSource:0}: Error finding container cea5d4b7369b0f72b1d7d7a9539d6f652e0b828c278d62d305fe520537ff42ba: Status 404 returned error can't find the container with id cea5d4b7369b0f72b1d7d7a9539d6f652e0b828c278d62d305fe520537ff42ba
Sep 15 20:05:07.029351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.029335    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 20:05:07.078187 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.078144    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:07.148156 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.148123    2554 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 20:05:07.178403 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.178370    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:07.278745 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.278661    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:07.379499 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.379460    2554 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-138.ec2.internal\" not found"
Sep 15 20:05:07.414833 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.414802    2554 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 20:05:07.447450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.447421    2554 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 20:05:07.478549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.478503    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:07.491843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.491818    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 20:05:07.492741 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.492714    2554 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"
Sep 15 20:05:07.500735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.500710    2554 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 20:05:07.855494 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.855459    2554 apiserver.go:52] "Watching apiserver"
Sep 15 20:05:07.863338 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.863314    2554 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 20:05:07.864301 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.864278    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-nx9gl","openshift-multus/multus-8chj2","openshift-multus/network-metrics-daemon-9b7xr","openshift-network-operator/iptables-alerter-4w22f","openshift-ovn-kubernetes/ovnkube-node-xxfl4","kube-system/global-pull-secret-syncer-x9gbq","kube-system/konnectivity-agent-5rbh9","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm","openshift-cluster-node-tuning-operator/tuned-kwwp4","openshift-dns/node-resolver-qhcsp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal","openshift-multus/multus-additional-cni-plugins-rr9rq","openshift-network-diagnostics/network-check-target-mp956","kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal"]
Sep 15 20:05:07.866662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.866642    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.869384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.869356    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 20:05:07.869525 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.869392    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-9ssgz\""
Sep 15 20:05:07.869525 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.869454    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 20:05:07.869913 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.869897    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:07.870025 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.870003    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:07.872084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.872066    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:07.872166 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.872131    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:07.874231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.874217    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.876687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.876657    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.876781 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.876719    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.876781 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.876771    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 20:05:07.877249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.877232    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7sdhq\""
Sep 15 20:05:07.877337 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.877276    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.878423 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.878400    2554 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 20:05:07.879016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.878996    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.879114 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.879059    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:07.879293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.879276    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 20:05:07.879521 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.879506    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.880275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.880255    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.880358 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.880328    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lfxsw\""
Sep 15 20:05:07.880413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.880351    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 20:05:07.880466 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.880413    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 20:05:07.881214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.881199    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.883399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.883382    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:07.883484 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.883464    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 20:05:07.883815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.883803    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.883864 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.883844    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-95s7m\""
Sep 15 20:05:07.884156 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.884143    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.885543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.885520    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 20:05:07.885626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.885571    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.886028 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.886008    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4tbcc\""
Sep 15 20:05:07.886235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.886220    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.887922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.887903    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:07.888264 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888226    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovn-node-metrics-cert\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888262    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-netns\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888289    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-etc-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-dbus\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.888377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888343    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:07.888377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888372    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dch42\" (UniqueName: \"kubernetes.io/projected/eae0f378-78d2-41d0-a359-668883a0cd11-kube-api-access-dch42\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888397    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888426    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-agent-certs\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888452    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888482    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-script-lib\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888507    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888554    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdk46\" (UniqueName: \"kubernetes.io/projected/e4559164-d611-4bd5-aa65-6a12d0f9c47b-kube-api-access-wdk46\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888570    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888585    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-systemd-units\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.888640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888611    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-systemd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888656    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-var-lib-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888682    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-node-log\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888725    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-netd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888798    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-config\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888830    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-58twt\" (UniqueName: \"kubernetes.io/projected/24d20fe3-2938-434c-819d-fe1c2bfda04d-kube-api-access-58twt\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-kubelet-config\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.888971    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24d20fe3-2938-434c-819d-fe1c2bfda04d-iptables-alerter-script\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889012    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-bin\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889033    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-env-overrides\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889048    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-konnectivity-ca\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889062    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d20fe3-2938-434c-819d-fe1c2bfda04d-host-slash\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-kubelet\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-slash\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889146    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-ovn\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889168    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-log-socket\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.889563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.889186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.890609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.890387    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.890744 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.890704    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.890909 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.890855    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 20:05:07.891012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.890951    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.891012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.890952    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 20:05:07.891128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.891018    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.891254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.891236    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.891317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.891293    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-t4whs\""
Sep 15 20:05:07.891437 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.891415    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r4hcp\""
Sep 15 20:05:07.892626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.892608    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 20:05:07.892783 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.892765    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.892880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.892801    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 20:05:07.892880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.892821    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 20:05:07.893135 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.893120    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-chq7b\""
Sep 15 20:05:07.894323 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.894304    2554 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 20:05:07.895127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.895108    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vws64\""
Sep 15 20:05:07.895220 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.895191    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 20:05:07.897285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.895817    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 20:05:07.919558 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.919531    2554 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2m998"
Sep 15 20:05:07.925794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.925765    2554 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2m998"
Sep 15 20:05:07.979342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.979315    2554 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 20:05:07.990200 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990170    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-konnectivity-ca\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.990200 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-kubelet\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990237    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-slash\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990261    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-ovn\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990285    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovn-node-metrics-cert\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990307    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-dbus\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990333    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990357    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cnibin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.990413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990380    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-netns\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990419    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-etc-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990443    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-registration-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990470    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dch42\" (UniqueName: \"kubernetes.io/projected/eae0f378-78d2-41d0-a359-668883a0cd11-kube-api-access-dch42\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990493    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990514    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-netns\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990535    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-sys-fs\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990556    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-sys\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990581    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990589    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-etc-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-script-lib\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgtsb\" (UniqueName: \"kubernetes.io/projected/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kube-api-access-rgtsb\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990667    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-dbus\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.990668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990671    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-lib-modules\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990711    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-host\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990739    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6015d577-ccef-4b0e-b044-555b6f100667-tmp-dir\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990767    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990798    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-systemd-units\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990806    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-kubelet\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-netd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990843    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-config\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990874    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-slash\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990882    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cni-binary-copy\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990921    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-ovn\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990930    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-modprobe-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990954    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-systemd\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.990960    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991039    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991054    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-netd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991068    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-58twt\" (UniqueName: \"kubernetes.io/projected/24d20fe3-2938-434c-819d-fe1c2bfda04d-kube-api-access-58twt\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991096    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-netns\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991124    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-etc-kubernetes\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991141    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-system-cni-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991143    2554 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-var-lib-kubelet\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991194    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kxwj\" (UniqueName: \"kubernetes.io/projected/bc1150a2-88c0-4b1f-b80f-f749799e333d-kube-api-access-5kxwj\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991227    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a9d341-1103-4d6c-9672-f8454d43b179-serviceca\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24d20fe3-2938-434c-819d-fe1c2bfda04d-iptables-alerter-script\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991296    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-env-overrides\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-kubelet\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991346    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991410    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-conf-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991448    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-daemon-config\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991477    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79798\" (UniqueName: \"kubernetes.io/projected/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-kube-api-access-79798\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991501    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-conf\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991532    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d20fe3-2938-434c-819d-fe1c2bfda04d-host-slash\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.991799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991560    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-log-socket\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991589    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-config\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991647    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-systemd-units\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-bin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991686    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-run-ovn-kubernetes\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991708    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-device-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991736    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-system-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991760    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-hostroot\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991786    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-socket-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991813    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt9mv\" (UniqueName: \"kubernetes.io/projected/d786166b-73d1-4c66-815e-0ef11d6ba633-kube-api-access-dt9mv\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991831    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-konnectivity-ca\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991840    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a9d341-1103-4d6c-9672-f8454d43b179-host\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991871    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991900    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-k8s-cni-cncf-io\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991911    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d20fe3-2938-434c-819d-fe1c2bfda04d-host-slash\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991929    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-multus\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.992424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991935    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-log-socket\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991871    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovnkube-script-lib\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991958    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-multus-certs\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.991956    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/24d20fe3-2938-434c-819d-fe1c2bfda04d-iptables-alerter-script\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992034    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-binary-copy\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992049    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e4559164-d611-4bd5-aa65-6a12d0f9c47b-env-overrides\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.992074    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992092    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-tuned\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992133    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-agent-certs\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.992163    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:08.492141956 +0000 UTC m=+2.937100956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992289    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992322    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-socket-dir-parent\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992360    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-tmp\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.992402    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992415    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6015d577-ccef-4b0e-b044-555b6f100667-hosts-file\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:07.993257 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.992502    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:08.492442263 +0000 UTC m=+2.937401258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992537    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdk46\" (UniqueName: \"kubernetes.io/projected/e4559164-d611-4bd5-aa65-6a12d0f9c47b-kube-api-access-wdk46\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992580    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-598kc\" (UniqueName: \"kubernetes.io/projected/6015d577-ccef-4b0e-b044-555b6f100667-kube-api-access-598kc\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992680    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-systemd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992708    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-var-lib-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992731    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-node-log\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992767    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-run-systemd\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992774    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-var-lib-openvswitch\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992787    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-cnibin\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysconfig\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992797    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-node-log\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992862    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-kubelet-config\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992898    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992918    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cdac05d3-89c4-4cac-a628-d8c27abd491d-kubelet-config\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.992942    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-run\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993008    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfgdv\" (UniqueName: \"kubernetes.io/projected/91a9d341-1103-4d6c-9672-f8454d43b179-kube-api-access-wfgdv\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993079    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-bin\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.993859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993119    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:07.994450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993162    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e4559164-d611-4bd5-aa65-6a12d0f9c47b-host-cni-bin\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.994450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:07.994450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.993210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-kubernetes\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:07.995345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.995320    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e4559164-d611-4bd5-aa65-6a12d0f9c47b-ovn-node-metrics-cert\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:07.995608 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.995588    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/167c36a0-cf9e-454c-a6c8-cdfc31feda2c-agent-certs\") pod \"konnectivity-agent-5rbh9\" (UID: \"167c36a0-cf9e-454c-a6c8-cdfc31feda2c\") " pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:07.996790 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.996771    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:07.996882 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.996797    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:07.996882 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.996811    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:07.996882 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:07.996863    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:08.496847223 +0000 UTC m=+2.941806222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:07.999298 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.999275    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-58twt\" (UniqueName: \"kubernetes.io/projected/24d20fe3-2938-434c-819d-fe1c2bfda04d-kube-api-access-58twt\") pod \"iptables-alerter-4w22f\" (UID: \"24d20fe3-2938-434c-819d-fe1c2bfda04d\") " pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:07.999377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:07.999356    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dch42\" (UniqueName: \"kubernetes.io/projected/eae0f378-78d2-41d0-a359-668883a0cd11-kube-api-access-dch42\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:08.005341 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.005321    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdk46\" (UniqueName: \"kubernetes.io/projected/e4559164-d611-4bd5-aa65-6a12d0f9c47b-kube-api-access-wdk46\") pod \"ovnkube-node-xxfl4\" (UID: \"e4559164-d611-4bd5-aa65-6a12d0f9c47b\") " pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:08.021427 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.021389    2554 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 20:05:08.022303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.022253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" event={"ID":"d5fe63d2e1dec62eab5d7d2258fa34d2","Type":"ContainerStarted","Data":"510bfb5e028fa4907b544af5030b626aface2afa5c0c90bb7c6fc491f5855513"}
Sep 15 20:05:08.023465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.023440    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerStarted","Data":"cea5d4b7369b0f72b1d7d7a9539d6f652e0b828c278d62d305fe520537ff42ba"}
Sep 15 20:05:08.093779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgtsb\" (UniqueName: \"kubernetes.io/projected/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kube-api-access-rgtsb\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.093779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-lib-modules\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-host\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093878    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-host\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093937    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-lib-modules\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.093939    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6015d577-ccef-4b0e-b044-555b6f100667-tmp-dir\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094018    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.094068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cni-binary-copy\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-modprobe-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094199    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-systemd\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094217    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-etc-selinux\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094239    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-etc-kubernetes\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094252    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6015d577-ccef-4b0e-b044-555b6f100667-tmp-dir\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094269    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-systemd\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094267    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-system-cni-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094302    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-system-cni-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094306    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-modprobe-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094307    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-etc-kubernetes\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-var-lib-kubelet\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kxwj\" (UniqueName: \"kubernetes.io/projected/bc1150a2-88c0-4b1f-b80f-f749799e333d-kube-api-access-5kxwj\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094371    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-var-lib-kubelet\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094383    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a9d341-1103-4d6c-9672-f8454d43b179-serviceca\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094410    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-kubelet\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094434    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-conf-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-daemon-config\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094485    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79798\" (UniqueName: \"kubernetes.io/projected/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-kube-api-access-79798\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-conf\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-bin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-device-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-system-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094603    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cni-binary-copy\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094608    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-hostroot\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094633    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-socket-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-conf-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094658    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt9mv\" (UniqueName: \"kubernetes.io/projected/d786166b-73d1-4c66-815e-0ef11d6ba633-kube-api-access-dt9mv\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094687    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a9d341-1103-4d6c-9672-f8454d43b179-host\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.094897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094697    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-kubelet\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094732    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-k8s-cni-cncf-io\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094739    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/91a9d341-1103-4d6c-9672-f8454d43b179-host\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-multus\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094777    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-multus-certs\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094798    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-binary-copy\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094842    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-tuned\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094856    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-conf\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-socket-dir-parent\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094901    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-bin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094903    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-tmp\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094917    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-multus-certs\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094968    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-k8s-cni-cncf-io\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095029    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6015d577-ccef-4b0e-b044-555b6f100667-hosts-file\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095038    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-var-lib-cni-multus\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095087    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6015d577-ccef-4b0e-b044-555b6f100667-hosts-file\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095110    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-device-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.095807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095115    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-598kc\" (UniqueName: \"kubernetes.io/projected/6015d577-ccef-4b0e-b044-555b6f100667-kube-api-access-598kc\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095152    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-cnibin\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysconfig\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095230    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-run\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095256    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095277    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfgdv\" (UniqueName: \"kubernetes.io/projected/91a9d341-1103-4d6c-9672-f8454d43b179-kube-api-access-wfgdv\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095289    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-daemon-config\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095302    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095326    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095397    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-socket-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095405    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-system-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095436    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-hostroot\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095444    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysconfig\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095478    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095484    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d786166b-73d1-4c66-815e-0ef11d6ba633-cnibin\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095541    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kubelet-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.096621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095547    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-kubernetes\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095588    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095595    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-sysctl-d\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095592    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-run\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-kubernetes\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095654    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-socket-dir-parent\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095664    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-multus-cni-dir\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.094880    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/91a9d341-1103-4d6c-9672-f8454d43b179-serviceca\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095659    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cnibin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095703    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-cnibin\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095712    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-registration-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-netns\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095781    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-sys-fs\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-sys\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095756    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-registration-dir\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095875    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bc1150a2-88c0-4b1f-b80f-f749799e333d-sys\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095892    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-host-run-netns\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.095923    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-sys-fs\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.097444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.096093    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-cni-binary-copy\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.098190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.096119    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/d786166b-73d1-4c66-815e-0ef11d6ba633-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.098190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.097929    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-tmp\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.098190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.098142    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bc1150a2-88c0-4b1f-b80f-f749799e333d-etc-tuned\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.103855 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.103817    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgtsb\" (UniqueName: \"kubernetes.io/projected/b8e0b22c-e3ee-428e-ae1c-68a83ba7644c-kube-api-access-rgtsb\") pod \"aws-ebs-csi-driver-node-dshmm\" (UID: \"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.104032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.103817    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kxwj\" (UniqueName: \"kubernetes.io/projected/bc1150a2-88c0-4b1f-b80f-f749799e333d-kube-api-access-5kxwj\") pod \"tuned-kwwp4\" (UID: \"bc1150a2-88c0-4b1f-b80f-f749799e333d\") " pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.104032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.103817    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfgdv\" (UniqueName: \"kubernetes.io/projected/91a9d341-1103-4d6c-9672-f8454d43b179-kube-api-access-wfgdv\") pod \"node-ca-nx9gl\" (UID: \"91a9d341-1103-4d6c-9672-f8454d43b179\") " pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.104487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.104461    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79798\" (UniqueName: \"kubernetes.io/projected/7a4a7ecd-044b-4cee-88c8-f7dbcbba2438-kube-api-access-79798\") pod \"multus-8chj2\" (UID: \"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438\") " pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.104959 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.104939    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-598kc\" (UniqueName: \"kubernetes.io/projected/6015d577-ccef-4b0e-b044-555b6f100667-kube-api-access-598kc\") pod \"node-resolver-qhcsp\" (UID: \"6015d577-ccef-4b0e-b044-555b6f100667\") " pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.105396 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.105360    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt9mv\" (UniqueName: \"kubernetes.io/projected/d786166b-73d1-4c66-815e-0ef11d6ba633-kube-api-access-dt9mv\") pod \"multus-additional-cni-plugins-rr9rq\" (UID: \"d786166b-73d1-4c66-815e-0ef11d6ba633\") " pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.177303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.177166    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:08.185510 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.185474    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4w22f"
Sep 15 20:05:08.195649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.195617    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:08.202600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.202567    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kwwp4"
Sep 15 20:05:08.208410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.208378    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nx9gl"
Sep 15 20:05:08.216251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.216223    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8chj2"
Sep 15 20:05:08.224095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.224065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qhcsp"
Sep 15 20:05:08.230050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.230028    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm"
Sep 15 20:05:08.236156 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.236134    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rr9rq"
Sep 15 20:05:08.311382 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.311159    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc1150a2_88c0_4b1f_b80f_f749799e333d.slice/crio-5b5dc59df3efb4dab5de5f6b3df37dc6941db046bca270d0921786ea185e49e1 WatchSource:0}: Error finding container 5b5dc59df3efb4dab5de5f6b3df37dc6941db046bca270d0921786ea185e49e1: Status 404 returned error can't find the container with id 5b5dc59df3efb4dab5de5f6b3df37dc6941db046bca270d0921786ea185e49e1
Sep 15 20:05:08.316877 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.316849    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4559164_d611_4bd5_aa65_6a12d0f9c47b.slice/crio-2a13533e8531c6ad6775c73d5239f467c06a27594296d5c14f1bb51c3a904081 WatchSource:0}: Error finding container 2a13533e8531c6ad6775c73d5239f467c06a27594296d5c14f1bb51c3a904081: Status 404 returned error can't find the container with id 2a13533e8531c6ad6775c73d5239f467c06a27594296d5c14f1bb51c3a904081
Sep 15 20:05:08.317456 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.317435    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd786166b_73d1_4c66_815e_0ef11d6ba633.slice/crio-33ec3adffbf567a38f2b9c4b477834f501bb85cf0ad1b806d4e235e25c6bdc2c WatchSource:0}: Error finding container 33ec3adffbf567a38f2b9c4b477834f501bb85cf0ad1b806d4e235e25c6bdc2c: Status 404 returned error can't find the container with id 33ec3adffbf567a38f2b9c4b477834f501bb85cf0ad1b806d4e235e25c6bdc2c
Sep 15 20:05:08.338461 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.338430    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d20fe3_2938_434c_819d_fe1c2bfda04d.slice/crio-f40372c7f2fba03a5ed3b475ab7fbffe1241e622acf2eacf567d950d824c12c0 WatchSource:0}: Error finding container f40372c7f2fba03a5ed3b475ab7fbffe1241e622acf2eacf567d950d824c12c0: Status 404 returned error can't find the container with id f40372c7f2fba03a5ed3b475ab7fbffe1241e622acf2eacf567d950d824c12c0
Sep 15 20:05:08.339665 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.339642    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod167c36a0_cf9e_454c_a6c8_cdfc31feda2c.slice/crio-796b7f098083918b220cd787bbf1147016fed8595391ca2f391ce5beea2d67ce WatchSource:0}: Error finding container 796b7f098083918b220cd787bbf1147016fed8595391ca2f391ce5beea2d67ce: Status 404 returned error can't find the container with id 796b7f098083918b220cd787bbf1147016fed8595391ca2f391ce5beea2d67ce
Sep 15 20:05:08.340661 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.340632    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a9d341_1103_4d6c_9672_f8454d43b179.slice/crio-a3cec330e3bd6da23358efe8a7d873e7bbee0a20b1cde2928c2b0c4a86a94ed5 WatchSource:0}: Error finding container a3cec330e3bd6da23358efe8a7d873e7bbee0a20b1cde2928c2b0c4a86a94ed5: Status 404 returned error can't find the container with id a3cec330e3bd6da23358efe8a7d873e7bbee0a20b1cde2928c2b0c4a86a94ed5
Sep 15 20:05:08.342927 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.342895    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8e0b22c_e3ee_428e_ae1c_68a83ba7644c.slice/crio-9f80aa0cb6f61d73653eda19ea63423342c1eadf494f0e7454afdef48ac2f759 WatchSource:0}: Error finding container 9f80aa0cb6f61d73653eda19ea63423342c1eadf494f0e7454afdef48ac2f759: Status 404 returned error can't find the container with id 9f80aa0cb6f61d73653eda19ea63423342c1eadf494f0e7454afdef48ac2f759
Sep 15 20:05:08.344785 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.344623    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6015d577_ccef_4b0e_b044_555b6f100667.slice/crio-a0dd98cb8036093d613ce1bf79795c974dd43b99ca7645fdbfe6c063653881eb WatchSource:0}: Error finding container a0dd98cb8036093d613ce1bf79795c974dd43b99ca7645fdbfe6c063653881eb: Status 404 returned error can't find the container with id a0dd98cb8036093d613ce1bf79795c974dd43b99ca7645fdbfe6c063653881eb
Sep 15 20:05:08.345402 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:08.345132    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a4a7ecd_044b_4cee_88c8_f7dbcbba2438.slice/crio-77db87548ec086e4a96da7d8c3916018fac19238656ac31366e3a769f338a12e WatchSource:0}: Error finding container 77db87548ec086e4a96da7d8c3916018fac19238656ac31366e3a769f338a12e: Status 404 returned error can't find the container with id 77db87548ec086e4a96da7d8c3916018fac19238656ac31366e3a769f338a12e
Sep 15 20:05:08.498078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.497952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:08.498078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.498022    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.498112    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498161    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498227    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:09.49820758 +0000 UTC m=+3.943166583 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498257    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498288    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:08.498340 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498303    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:08.498645 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498355    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:09.498339833 +0000 UTC m=+3.943298839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:08.498645 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498258    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:08.498645 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:08.498403    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:09.498394163 +0000 UTC m=+3.943353153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:08.929115 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.928916    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 20:00:08 +0000 UTC" deadline="2028-06-18 19:19:14.598620544 +0000 UTC"
Sep 15 20:05:08.929115 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:08.928962    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15407h14m5.669663993s"
Sep 15 20:05:09.018018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.017496    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:09.018018 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.017632    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:09.033820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.033774    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm" event={"ID":"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c","Type":"ContainerStarted","Data":"9f80aa0cb6f61d73653eda19ea63423342c1eadf494f0e7454afdef48ac2f759"}
Sep 15 20:05:09.040804 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.040765    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx9gl" event={"ID":"91a9d341-1103-4d6c-9672-f8454d43b179","Type":"ContainerStarted","Data":"a3cec330e3bd6da23358efe8a7d873e7bbee0a20b1cde2928c2b0c4a86a94ed5"}
Sep 15 20:05:09.048374 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.048335    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rbh9" event={"ID":"167c36a0-cf9e-454c-a6c8-cdfc31feda2c","Type":"ContainerStarted","Data":"796b7f098083918b220cd787bbf1147016fed8595391ca2f391ce5beea2d67ce"}
Sep 15 20:05:09.054403 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.054340    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4w22f" event={"ID":"24d20fe3-2938-434c-819d-fe1c2bfda04d","Type":"ContainerStarted","Data":"f40372c7f2fba03a5ed3b475ab7fbffe1241e622acf2eacf567d950d824c12c0"}
Sep 15 20:05:09.057811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.057776    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"2a13533e8531c6ad6775c73d5239f467c06a27594296d5c14f1bb51c3a904081"}
Sep 15 20:05:09.061567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.061529    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwwp4" event={"ID":"bc1150a2-88c0-4b1f-b80f-f749799e333d","Type":"ContainerStarted","Data":"5b5dc59df3efb4dab5de5f6b3df37dc6941db046bca270d0921786ea185e49e1"}
Sep 15 20:05:09.071833 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.070570    2554 generic.go:356] "Generic (PLEG): container finished" podID="9d9c349dff749c2683923cdd68686644" containerID="bd1b4291e4a6044af685648f4340828659f76fb55343f2bf19cde95b3102ab8c" exitCode=0
Sep 15 20:05:09.071833 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.070866    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerDied","Data":"bd1b4291e4a6044af685648f4340828659f76fb55343f2bf19cde95b3102ab8c"}
Sep 15 20:05:09.078088 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.078016    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhcsp" event={"ID":"6015d577-ccef-4b0e-b044-555b6f100667","Type":"ContainerStarted","Data":"a0dd98cb8036093d613ce1bf79795c974dd43b99ca7645fdbfe6c063653881eb"}
Sep 15 20:05:09.081135 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.081052    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerStarted","Data":"33ec3adffbf567a38f2b9c4b477834f501bb85cf0ad1b806d4e235e25c6bdc2c"}
Sep 15 20:05:09.085013 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.084987    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8chj2" event={"ID":"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438","Type":"ContainerStarted","Data":"77db87548ec086e4a96da7d8c3916018fac19238656ac31366e3a769f338a12e"}
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.509801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.509868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.509905    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510015    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510044    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510056    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510120    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510126    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:11.510106401 +0000 UTC m=+5.955065394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510058    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510174    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:11.510156518 +0000 UTC m=+5.955115505 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:09.510627 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:09.510197    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:11.510186726 +0000 UTC m=+5.955145713 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:09.929663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.929540    2554 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 20:00:08 +0000 UTC" deadline="2028-06-13 06:31:16.842615458 +0000 UTC"
Sep 15 20:05:09.929663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:09.929608    2554 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15274h26m6.913011094s"
Sep 15 20:05:10.020170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:10.020137    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:10.020346 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:10.020269    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:10.020726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:10.020703    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:10.020858 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:10.020815    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:11.017745 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:11.017688    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:11.018341 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.017972    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:11.527103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:11.527057    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:11.527272 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:11.527128    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:11.527272 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:11.527160    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:11.527399 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527339    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:11.527399 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527369    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:11.527399 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527374    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:11.527399 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527383    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:11.527603 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527433    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:11.527603 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527439    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:15.527420359 +0000 UTC m=+9.972379360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:11.527603 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527459    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:15.527449888 +0000 UTC m=+9.972408878 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:11.527603 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:11.527474    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:15.527465552 +0000 UTC m=+9.972424538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:12.018307 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:12.018217    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:12.018752 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:12.018361    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:12.018752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:12.018442    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:12.018752 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:12.018563    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:13.018067 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:13.017459    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:13.018067 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:13.017623    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:14.017594 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:14.017560    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:14.018129 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:14.017570    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:14.018129 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:14.017703    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:14.018129 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:14.017804    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:15.017377 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:15.017282    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:15.017546 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.017425    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:15.559837 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:15.559791    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:15.559848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.559950    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:15.559967    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560004    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560025    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:23.560008444 +0000 UTC m=+18.004967449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560030    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560042    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560075    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560089    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:23.560071458 +0000 UTC m=+18.005030453 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:15.560284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:15.560129    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:23.560113991 +0000 UTC m=+18.005072996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:16.018361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:16.018326    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:16.018536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:16.018412    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:16.018536 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:16.018433    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:16.018634 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:16.018530    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:17.017807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:17.017558    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:17.017807 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:17.017705    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:18.018268 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:18.018233    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:18.019108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:18.018277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:18.019108 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:18.018370    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:18.019108 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:18.018707    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:19.017116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:19.017076    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:19.017266 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:19.017186    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:20.018218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:20.018182    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:20.018682 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:20.018182    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:20.018682 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:20.018305    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:20.018682 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:20.018406    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:21.017310 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:21.017273    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:21.017491 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:21.017416    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:22.017685 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:22.017646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:22.018126 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:22.017646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:22.018126 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:22.017804    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:22.018126 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:22.017918    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:23.018159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:23.018118    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:23.018658 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.018242    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:23.620416 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:23.620369    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:23.620606 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:23.620441    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:23.620606 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:23.620469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:23.620606 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620560    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:23.620780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620642    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:39.62062247 +0000 UTC m=+34.065581473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:23.620780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620567    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:23.620780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620723    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:05:39.62070989 +0000 UTC m=+34.065668876 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:23.620780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620565    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:23.620780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620755    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:23.621028 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620790    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:23.621028 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:23.620825    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:05:39.620814262 +0000 UTC m=+34.065773250 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:24.017811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:24.017720    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:24.017962 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:24.017720    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:24.017962 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:24.017863    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:24.017962 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:24.017926    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:25.018015 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:25.017967    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:25.018468 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:25.018120    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:26.017874 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:26.017838    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:26.018116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:26.017928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:26.018116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:26.017947    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:26.018116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:26.018052    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:27.018137 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.017755    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:27.018565 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:27.018180    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:27.131077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.131043    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kwwp4" event={"ID":"bc1150a2-88c0-4b1f-b80f-f749799e333d","Type":"ContainerStarted","Data":"cb23b40891b5baf49a510ca3d7659ec52abfba537f02bae409e0ba1a9735cfae"}
Sep 15 20:05:27.133356 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.133327    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" event={"ID":"9d9c349dff749c2683923cdd68686644","Type":"ContainerStarted","Data":"f0c0448af61630e328e69cf99cc3427bc489c66f5680c1acfc4007941fd94ef8"}
Sep 15 20:05:27.134845 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.134817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qhcsp" event={"ID":"6015d577-ccef-4b0e-b044-555b6f100667","Type":"ContainerStarted","Data":"7c4bacef9e67d9fcb90b6aa194abff3961d0f4d6ec7c02924af127635f22a851"}
Sep 15 20:05:27.136374 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.136352    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="b6ac69545d776f174e472626f3be3ae28ee4b1aed536ba82b2a5dfd967e4aa38" exitCode=0
Sep 15 20:05:27.136469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.136432    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"b6ac69545d776f174e472626f3be3ae28ee4b1aed536ba82b2a5dfd967e4aa38"}
Sep 15 20:05:27.137994 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.137946    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" event={"ID":"d5fe63d2e1dec62eab5d7d2258fa34d2","Type":"ContainerStarted","Data":"1a0036a37cd1cee96179cc2eda700fc61766e26e4c132bd8d8bf619db0defbe2"}
Sep 15 20:05:27.139551 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.139526    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8chj2" event={"ID":"7a4a7ecd-044b-4cee-88c8-f7dbcbba2438","Type":"ContainerStarted","Data":"e40ba6b904ad0ee4d3ff0f866fb829d855c449d0547faa9365317a54f7e820be"}
Sep 15 20:05:27.141003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.140971    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm" event={"ID":"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c","Type":"ContainerStarted","Data":"1d37b9e43e611c97fe15fc7b6385b2e8dcce92e34e70b43bb209778285b7de0f"}
Sep 15 20:05:27.142573 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.142550    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nx9gl" event={"ID":"91a9d341-1103-4d6c-9672-f8454d43b179","Type":"ContainerStarted","Data":"8e3e84060b57f43dd0f3b0c1822026a2bd4b4f4cb125d1531a17a6ef6942f859"}
Sep 15 20:05:27.144613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.144587    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rbh9" event={"ID":"167c36a0-cf9e-454c-a6c8-cdfc31feda2c","Type":"ContainerStarted","Data":"37b0031a57cced81bd653e83c8e9a97c4b24b19aac29a9574ccb3be8cd2e2951"}
Sep 15 20:05:27.147214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.147192    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"740ea67a80066a2b60ce994336b333e9d3a6eb942e1a65730fedd70b9a1f7cc3"}
Sep 15 20:05:27.147295 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.147253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"698e744acd8215e5b845d02a11d4f38f50dec95cc95bb379ab1181cf373e0da9"}
Sep 15 20:05:27.147295 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.147285    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"5e65e15125fccf9026ad18fbb020f66b8d0038500a62e19989118cde496b1e10"}
Sep 15 20:05:27.147355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.147312    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"0a6736ae576a7d1bc3e96dce15f463f27072ac8e5f24eb2eac03e945c38ab8a2"}
Sep 15 20:05:27.147963 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.147920    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kwwp4" podStartSLOduration=2.9042806260000003 podStartE2EDuration="21.147906392s" totalImagesPullingTime="18.243625766s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.147487376 +0000 UTC m=+21.592446385" watchObservedRunningTime="2026-09-15 20:05:27.147906392 +0000 UTC m=+21.592865402"
Sep 15 20:05:27.164552 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.164498    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-138.ec2.internal" podStartSLOduration=20.164482722 podStartE2EDuration="20.164482722s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.164479294 +0000 UTC m=+21.609438302" watchObservedRunningTime="2026-09-15 20:05:27.164482722 +0000 UTC m=+21.609441729"
Sep 15 20:05:27.179016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.178957    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-138.ec2.internal" podStartSLOduration=20.178940702 podStartE2EDuration="20.178940702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.17851368 +0000 UTC m=+21.623472688" watchObservedRunningTime="2026-09-15 20:05:27.178940702 +0000 UTC m=+21.623899711"
Sep 15 20:05:27.193874 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.193833    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5rbh9" podStartSLOduration=3.011727387 podStartE2EDuration="21.193816981s" totalImagesPullingTime="18.182089594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.193365456 +0000 UTC m=+21.638324464" watchObservedRunningTime="2026-09-15 20:05:27.193816981 +0000 UTC m=+21.638775985"
Sep 15 20:05:27.207996 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.207945    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nx9gl" podStartSLOduration=3.019213558 podStartE2EDuration="21.207930244s" totalImagesPullingTime="18.188716686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.207855619 +0000 UTC m=+21.652814627" watchObservedRunningTime="2026-09-15 20:05:27.207930244 +0000 UTC m=+21.652889252"
Sep 15 20:05:27.223144 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.223090    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qhcsp" podStartSLOduration=7.128338706 podStartE2EDuration="21.223071414s" totalImagesPullingTime="14.094732708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.222644549 +0000 UTC m=+21.667603558" watchObservedRunningTime="2026-09-15 20:05:27.223071414 +0000 UTC m=+21.668030422"
Sep 15 20:05:27.244371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.244320    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8chj2" podStartSLOduration=2.993730826 podStartE2EDuration="21.244303851s" totalImagesPullingTime="18.250573025s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:27.243766366 +0000 UTC m=+21.688725373" watchObservedRunningTime="2026-09-15 20:05:27.244303851 +0000 UTC m=+21.689262858"
Sep 15 20:05:27.257349 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.257314    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:27.257857 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:27.257838    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:28.017354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.017321    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:28.017541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.017332    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:28.017541 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:28.017432    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:28.017541 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:28.017532    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:28.150290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.150258    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4w22f" event={"ID":"24d20fe3-2938-434c-819d-fe1c2bfda04d","Type":"ContainerStarted","Data":"776e01899d0bbad7437eb1a137b1d4a8fbb4d17b04f9fbde94e851772970a632"}
Sep 15 20:05:28.153398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.153362    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"d585d550752ea510ce1433914fdce70261fcd9e95d3604590bc217b5fa296ab9"}
Sep 15 20:05:28.153536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.153437    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"cf2e27330285f1a88e60cf9b189d1e2ef7697846f4bc778a1e1aeab40c6c8f28"}
Sep 15 20:05:28.166543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.166489    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4w22f" podStartSLOduration=3.950627579 podStartE2EDuration="22.166471367s" totalImagesPullingTime="18.215843788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:28.1663828 +0000 UTC m=+22.611341807" watchObservedRunningTime="2026-09-15 20:05:28.166471367 +0000 UTC m=+22.611430374"
Sep 15 20:05:28.441478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.441305    2554 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 20:05:28.961084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.960943    2554 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T20:05:28.441459379Z","UUID":"3eebe529-619d-47b2-99ed-913765a90ae0","Handler":null,"Name":"","Endpoint":""}
Sep 15 20:05:28.962684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.962658    2554 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 20:05:28.962684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:28.962691    2554 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 20:05:29.017723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:29.017684    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:29.017898 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:29.017814    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:29.159646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:29.159611    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm" event={"ID":"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c","Type":"ContainerStarted","Data":"ba4b02787d096ace58680da5a05e6ce4e0bbc2a6481b92f7d05566fa096ed437"}
Sep 15 20:05:29.160113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:29.159656    2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 20:05:30.017836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:30.017801    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:30.018056 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:30.017935    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:30.018056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:30.018013    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:30.018176 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:30.018141    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:30.164703 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:30.164645    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm" event={"ID":"b8e0b22c-e3ee-428e-ae1c-68a83ba7644c","Type":"ContainerStarted","Data":"eafad39c45f62decae97c13020dcb05ab0564babbbc10aa3640c41c383201f2e"}
Sep 15 20:05:30.168605 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:30.168571    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"534c58cd17ee149506ceb8b19451442547459c62409be1e8b66e9e8836b59196"}
Sep 15 20:05:30.183558 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:30.183500    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-dshmm" podStartSLOduration=3.7592081999999998 podStartE2EDuration="24.183484488s" totalImagesPullingTime="20.424276288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:30.182832928 +0000 UTC m=+24.627791960" watchObservedRunningTime="2026-09-15 20:05:30.183484488 +0000 UTC m=+24.628443527"
Sep 15 20:05:31.017174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:31.017125    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:31.017392 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:31.017263    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:32.017860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:32.017826    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:32.018330 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:32.017827    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:32.018330 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:32.017960    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:32.018330 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:32.018055    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:32.968797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:32.967530    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:32.968797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:32.968071    2554 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Sep 15 20:05:32.973950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:32.970395    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5rbh9"
Sep 15 20:05:33.017853 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.017822    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:33.017968 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:33.017939    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:33.180122 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.179872    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" event={"ID":"e4559164-d611-4bd5-aa65-6a12d0f9c47b","Type":"ContainerStarted","Data":"5aafb5737e5154e2b13e3e20aceb5d83ee8bd483f456a9fd23bcbc827bdb4daa"}
Sep 15 20:05:33.180304 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.180176    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:33.181958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.181931    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="c43b17d7884e2f8b83005fae6b1770bea658b1d2a382a66b6d5bff17ebcc5b30" exitCode=0
Sep 15 20:05:33.182080 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.181991    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"c43b17d7884e2f8b83005fae6b1770bea658b1d2a382a66b6d5bff17ebcc5b30"}
Sep 15 20:05:33.195608 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.195586    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:33.206894 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:33.206851    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4" podStartSLOduration=8.82485703 podStartE2EDuration="27.206837078s" totalImagesPullingTime="18.381980048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:33.205047716 +0000 UTC m=+27.650006723" watchObservedRunningTime="2026-09-15 20:05:33.206837078 +0000 UTC m=+27.651796086"
Sep 15 20:05:34.018047 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.018015    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:34.018664 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.018050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:34.018664 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:34.018148    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:34.018664 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:34.018271    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:34.185393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.185362    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:34.185560 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.185450    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:34.205595 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.205567    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:05:34.963412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.963375    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp956"]
Sep 15 20:05:34.963559 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.963541    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:34.963679 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:34.963654    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:34.966545 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.966517    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b7xr"]
Sep 15 20:05:34.966700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.966646    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:34.966793 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:34.966773    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:34.967179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.967156    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9gbq"]
Sep 15 20:05:34.967308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:34.967292    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:34.967394 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:34.967377    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:35.189517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:35.189426    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="f8135c00a5d95efbca914fd2c0608e94cf700a098ab04284f8b9d7088bba5ad3" exitCode=0
Sep 15 20:05:35.189517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:35.189504    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"f8135c00a5d95efbca914fd2c0608e94cf700a098ab04284f8b9d7088bba5ad3"}
Sep 15 20:05:36.018081 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:36.017881    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:36.018246 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:36.018153    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:37.017702 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:37.017664    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:37.018168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:37.017683    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:37.018168 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:37.017764    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:37.018168 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:37.017847    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:37.196566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:37.196533    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="450b30cde3ec9ea7dac9c06fa9b68dcde9b13d4f0683bbd6f7ff271faae44d4e" exitCode=0
Sep 15 20:05:37.196566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:37.196569    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"450b30cde3ec9ea7dac9c06fa9b68dcde9b13d4f0683bbd6f7ff271faae44d4e"}
Sep 15 20:05:38.017497 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:38.017457    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:38.017652 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:38.017597    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:39.018123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:39.018089    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:39.018586 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.018237    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-x9gbq" podUID="cdac05d3-89c4-4cac-a628-d8c27abd491d"
Sep 15 20:05:39.018586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:39.018288    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:39.018586 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.018420    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:05:39.631849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:39.631801    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:39.631849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:39.631853    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:39.631890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.631971    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632009    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632026    2554 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632034    2554 projected.go:196] Error preparing data for projected volume kube-api-access-vqc7w for pod openshift-network-diagnostics/network-check-target-mp956: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632045    2554 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632074    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:06:11.632053779 +0000 UTC m=+66.077012782 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632098    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret podName:cdac05d3-89c4-4cac-a628-d8c27abd491d nodeName:}" failed. No retries permitted until 2026-09-15 20:06:11.632086913 +0000 UTC m=+66.077045905 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret") pod "global-pull-secret-syncer-x9gbq" (UID: "cdac05d3-89c4-4cac-a628-d8c27abd491d") : object "kube-system"/"original-pull-secret" not registered
Sep 15 20:05:39.632116 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:39.632113    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w podName:3522c6a5-691f-4a92-9eed-b4663b2e057c nodeName:}" failed. No retries permitted until 2026-09-15 20:06:11.632105132 +0000 UTC m=+66.077064118 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vqc7w" (UniqueName: "kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w") pod "network-check-target-mp956" (UID: "3522c6a5-691f-4a92-9eed-b4663b2e057c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 20:05:40.017384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.017349    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:40.017592 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:40.017494    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mp956" podUID="3522c6a5-691f-4a92-9eed-b4663b2e057c"
Sep 15 20:05:40.350786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.350705    2554 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-138.ec2.internal" event="NodeReady"
Sep 15 20:05:40.351236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.350886    2554 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 20:05:40.398474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.398441    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gpnkz"]
Sep 15 20:05:40.420090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.420048    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lxmzf"]
Sep 15 20:05:40.420275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.420204    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.422776 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.422747    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwzj9\""
Sep 15 20:05:40.423086 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.423064    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 20:05:40.423204 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.423061    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 20:05:40.433737 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.433708    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpnkz"]
Sep 15 20:05:40.433874 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.433754    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxmzf"]
Sep 15 20:05:40.433874 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.433845    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.436730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.436682    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 20:05:40.436730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.436707    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lzsdw\""
Sep 15 20:05:40.436919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.436741    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 20:05:40.437058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.437024    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 20:05:40.538957 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.538917    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.538957 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.538961    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/989a3f9f-1483-41c6-9523-eb28dca75372-cert\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.539224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.539138    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cae6c4-78ed-4d09-a44f-e065014477e7-config-volume\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.539224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.539175    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tj4wd\" (UniqueName: \"kubernetes.io/projected/989a3f9f-1483-41c6-9523-eb28dca75372-kube-api-access-tj4wd\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.539347 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.539275    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9ft5k\" (UniqueName: \"kubernetes.io/projected/a6cae6c4-78ed-4d09-a44f-e065014477e7-kube-api-access-9ft5k\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.539347 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.539318    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cae6c4-78ed-4d09-a44f-e065014477e7-tmp-dir\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.639728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cae6c4-78ed-4d09-a44f-e065014477e7-config-volume\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.639898 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639737    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tj4wd\" (UniqueName: \"kubernetes.io/projected/989a3f9f-1483-41c6-9523-eb28dca75372-kube-api-access-tj4wd\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.639898 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9ft5k\" (UniqueName: \"kubernetes.io/projected/a6cae6c4-78ed-4d09-a44f-e065014477e7-kube-api-access-9ft5k\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.639898 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639862    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cae6c4-78ed-4d09-a44f-e065014477e7-tmp-dir\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.639898 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639895    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.640132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.639916    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/989a3f9f-1483-41c6-9523-eb28dca75372-cert\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.640132 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:40.640082    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:40.640243 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:40.640154    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:41.140134792 +0000 UTC m=+35.585093791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:05:40.640243 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.640218    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6cae6c4-78ed-4d09-a44f-e065014477e7-tmp-dir\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.640346 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.640238    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/a6cae6c4-78ed-4d09-a44f-e065014477e7-config-volume\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.644333 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.644309    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/989a3f9f-1483-41c6-9523-eb28dca75372-cert\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.650008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.649953    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9ft5k\" (UniqueName: \"kubernetes.io/projected/a6cae6c4-78ed-4d09-a44f-e065014477e7-kube-api-access-9ft5k\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:40.650392 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.650367    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tj4wd\" (UniqueName: \"kubernetes.io/projected/989a3f9f-1483-41c6-9523-eb28dca75372-kube-api-access-tj4wd\") pod \"ingress-canary-lxmzf\" (UID: \"989a3f9f-1483-41c6-9523-eb28dca75372\") " pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:40.744471 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:40.744431    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lxmzf"
Sep 15 20:05:41.017571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.017525    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:05:41.017743 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.017577    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:05:41.020328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.020302    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 20:05:41.020492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.020352    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9zsw\""
Sep 15 20:05:41.020492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.020439    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 20:05:41.143247 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:41.143212    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:41.143397 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:41.143383    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:41.143473 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:41.143460    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:42.14343698 +0000 UTC m=+36.588395978 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:05:42.018153 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.017890    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:05:42.020956 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.020934    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxg67\""
Sep 15 20:05:42.021091 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.020975    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 20:05:42.021091 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.021016    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 20:05:42.046023 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.045976    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lxmzf"]
Sep 15 20:05:42.050017 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:05:42.049947    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod989a3f9f_1483_41c6_9523_eb28dca75372.slice/crio-12fe7d62567c3254480d0099694c7265e772cabe919a1c8cf5fa1a952c36c896 WatchSource:0}: Error finding container 12fe7d62567c3254480d0099694c7265e772cabe919a1c8cf5fa1a952c36c896: Status 404 returned error can't find the container with id 12fe7d62567c3254480d0099694c7265e772cabe919a1c8cf5fa1a952c36c896
Sep 15 20:05:42.150654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.150615    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:42.150827 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:42.150785    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:42.150875 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:42.150852    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:44.150835323 +0000 UTC m=+38.595794314 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:05:42.212222 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.212182    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerStarted","Data":"de54bcbbcfaeeffef367d0156a91a6d191d2ce43a03fb0b54b17cd791b411312"}
Sep 15 20:05:42.213492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:42.213455    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxmzf" event={"ID":"989a3f9f-1483-41c6-9523-eb28dca75372","Type":"ContainerStarted","Data":"12fe7d62567c3254480d0099694c7265e772cabe919a1c8cf5fa1a952c36c896"}
Sep 15 20:05:43.220158 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:43.220096    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="de54bcbbcfaeeffef367d0156a91a6d191d2ce43a03fb0b54b17cd791b411312" exitCode=0
Sep 15 20:05:43.220158 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:43.220154    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"de54bcbbcfaeeffef367d0156a91a6d191d2ce43a03fb0b54b17cd791b411312"}
Sep 15 20:05:44.163598 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:44.163562    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:44.163780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:44.163696    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:44.163780 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:44.163765    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:48.16375123 +0000 UTC m=+42.608710216 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:05:44.226503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:44.226471    2554 generic.go:356] "Generic (PLEG): container finished" podID="d786166b-73d1-4c66-815e-0ef11d6ba633" containerID="7055c0e8c661a659e480e8bd9893cb10c237dc647fa0d2f5375fbe1c41718ae2" exitCode=0
Sep 15 20:05:44.227061 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:44.226556    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerDied","Data":"7055c0e8c661a659e480e8bd9893cb10c237dc647fa0d2f5375fbe1c41718ae2"}
Sep 15 20:05:45.233070 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:45.233026    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" event={"ID":"d786166b-73d1-4c66-815e-0ef11d6ba633","Type":"ContainerStarted","Data":"6aae3de55390f7b21e7c3b0f4a6a851735abc10bf783d702a898871fcef4aa9e"}
Sep 15 20:05:45.234740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:45.234711    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lxmzf" event={"ID":"989a3f9f-1483-41c6-9523-eb28dca75372","Type":"ContainerStarted","Data":"5eb361826ff4fb5eef49424fc2670083136c11ab98e68f15c770733c8f1877d2"}
Sep 15 20:05:45.255349 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:45.255291    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rr9rq" podStartSLOduration=8.150994709 podStartE2EDuration="39.255273407s" totalImagesPullingTime="31.104278698s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:45.253518161 +0000 UTC m=+39.698477169" watchObservedRunningTime="2026-09-15 20:05:45.255273407 +0000 UTC m=+39.700232448"
Sep 15 20:05:45.270363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:45.270308    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lxmzf" podStartSLOduration=2.303877999 podStartE2EDuration="5.270290374s" totalImagesPullingTime="2.966412375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:05:45.269717725 +0000 UTC m=+39.714676734" watchObservedRunningTime="2026-09-15 20:05:45.270290374 +0000 UTC m=+39.715249382"
Sep 15 20:05:48.193809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:48.193760    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:48.194231 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:48.193908    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:48.194231 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:48.193976    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:05:56.193961878 +0000 UTC m=+50.638920864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:05:56.246446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:05:56.246391    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:05:56.246922 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:56.246529    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:05:56.246922 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:05:56.246592    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:06:12.246576903 +0000 UTC m=+66.691535893 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:06:06.208117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:06.208088    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xxfl4"
Sep 15 20:06:11.656333 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.656290    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:06:11.656333 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.656332    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:06:11.656758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.656489    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:06:11.659328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.659303    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 20:06:11.659447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.659395    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 20:06:11.659447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.659401    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 20:06:11.666986 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:11.666966    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 20:06:11.667093 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:11.667081    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:07:15.667061469 +0000 UTC m=+130.112020459 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : secret "metrics-daemon-secret" not found
Sep 15 20:06:11.669412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.669393    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 20:06:11.669749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.669730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cdac05d3-89c4-4cac-a628-d8c27abd491d-original-pull-secret\") pod \"global-pull-secret-syncer-x9gbq\" (UID: \"cdac05d3-89c4-4cac-a628-d8c27abd491d\") " pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:06:11.679639 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.679609    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqc7w\" (UniqueName: \"kubernetes.io/projected/3522c6a5-691f-4a92-9eed-b4663b2e057c-kube-api-access-vqc7w\") pod \"network-check-target-mp956\" (UID: \"3522c6a5-691f-4a92-9eed-b4663b2e057c\") " pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:06:11.737458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.737424    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-fxg67\""
Sep 15 20:06:11.745607 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.745583    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:06:11.932069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:11.931949    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-x9gbq"
Sep 15 20:06:12.016323 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:12.016292    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mp956"]
Sep 15 20:06:12.019512 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:06:12.019480    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3522c6a5_691f_4a92_9eed_b4663b2e057c.slice/crio-f58a1ad58f12f1a7ae66f329bec4372066543873ece98d18b3ee00e017a51f7f WatchSource:0}: Error finding container f58a1ad58f12f1a7ae66f329bec4372066543873ece98d18b3ee00e017a51f7f: Status 404 returned error can't find the container with id f58a1ad58f12f1a7ae66f329bec4372066543873ece98d18b3ee00e017a51f7f
Sep 15 20:06:12.201143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:12.201045    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-x9gbq"]
Sep 15 20:06:12.205219 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:06:12.205193    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdac05d3_89c4_4cac_a628_d8c27abd491d.slice/crio-8a97824fb065f3c391d35abf74ed2576d19166f18235dbba9bd5babd3ba98ab2 WatchSource:0}: Error finding container 8a97824fb065f3c391d35abf74ed2576d19166f18235dbba9bd5babd3ba98ab2: Status 404 returned error can't find the container with id 8a97824fb065f3c391d35abf74ed2576d19166f18235dbba9bd5babd3ba98ab2
Sep 15 20:06:12.260965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:12.260926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:06:12.261154 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:12.261071    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:06:12.261154 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:12.261126    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:06:44.261113875 +0000 UTC m=+98.706072861 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:06:12.299309 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:12.299266    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9gbq" event={"ID":"cdac05d3-89c4-4cac-a628-d8c27abd491d","Type":"ContainerStarted","Data":"8a97824fb065f3c391d35abf74ed2576d19166f18235dbba9bd5babd3ba98ab2"}
Sep 15 20:06:12.300397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:12.300373    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp956" event={"ID":"3522c6a5-691f-4a92-9eed-b4663b2e057c","Type":"ContainerStarted","Data":"f58a1ad58f12f1a7ae66f329bec4372066543873ece98d18b3ee00e017a51f7f"}
Sep 15 20:06:13.131527 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.131489    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"]
Sep 15 20:06:13.134541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.134519    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.134668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.134627    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"]
Sep 15 20:06:13.137014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.136992    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 20:06:13.137204 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.137191    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 20:06:13.137255 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.137237    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 20:06:13.137342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.137326    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.138085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.138066    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 20:06:13.141205 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.141182    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 20:06:13.141634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.141424    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 20:06:13.141709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.141684    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 20:06:13.142380 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.142361    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 20:06:13.150432 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.150408    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"]
Sep 15 20:06:13.159511 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.159452    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"]
Sep 15 20:06:13.267499 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267460    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267499 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267500    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nfnt2\" (UniqueName: \"kubernetes.io/projected/d290ee1e-0f79-495d-b790-a260290ad040-kube-api-access-nfnt2\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267521    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267596    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267694    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-tmp\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.267810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267723    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.267810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267764    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267789    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d290ee1e-0f79-495d-b790-a260290ad040-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.267810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.267808    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tbfc\" (UniqueName: \"kubernetes.io/projected/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-kube-api-access-8tbfc\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.368689 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.368883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368702    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nfnt2\" (UniqueName: \"kubernetes.io/projected/d290ee1e-0f79-495d-b790-a260290ad040-kube-api-access-nfnt2\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.368883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368805    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.368883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368866    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.369084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368892    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-tmp\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.369084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.368911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.371064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.369402    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.371064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.369687    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-tmp\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.372732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.371678    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d290ee1e-0f79-495d-b790-a260290ad040-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.372732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.371734    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tbfc\" (UniqueName: \"kubernetes.io/projected/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-kube-api-access-8tbfc\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.375058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.372729    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.375058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.372878    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/d290ee1e-0f79-495d-b790-a260290ad040-additional-service-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.375058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.372973    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-klusterlet-config\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.376170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.376114    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.376299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.376177    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-ca\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.377135 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.377111    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d290ee1e-0f79-495d-b790-a260290ad040-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.378678 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.378658    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nfnt2\" (UniqueName: \"kubernetes.io/projected/d290ee1e-0f79-495d-b790-a260290ad040-kube-api-access-nfnt2\") pod \"cluster-proxy-proxy-agent-7d4b75fc67-wxw59\" (UID: \"d290ee1e-0f79-495d-b790-a260290ad040\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.380272 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.380246    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tbfc\" (UniqueName: \"kubernetes.io/projected/5810f38d-fd4d-4dc0-a912-546a8cc2bd40-kube-api-access-8tbfc\") pod \"klusterlet-addon-workmgr-69f75899cc-w9tr2\" (UID: \"5810f38d-fd4d-4dc0-a912-546a8cc2bd40\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.445141 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.445044    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:13.462202 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.462167    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:06:13.734117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.734000    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"]
Sep 15 20:06:13.739814 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:06:13.739666    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5810f38d_fd4d_4dc0_a912_546a8cc2bd40.slice/crio-0654d9d17de1f62b9be6cc9480d8f7491365038b07d5b71c1e4d25ab3ee6da42 WatchSource:0}: Error finding container 0654d9d17de1f62b9be6cc9480d8f7491365038b07d5b71c1e4d25ab3ee6da42: Status 404 returned error can't find the container with id 0654d9d17de1f62b9be6cc9480d8f7491365038b07d5b71c1e4d25ab3ee6da42
Sep 15 20:06:13.762203 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:13.762169    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"]
Sep 15 20:06:13.766544 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:06:13.766508    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd290ee1e_0f79_495d_b790_a260290ad040.slice/crio-e46954e79c1faca5ab39f4f0451ee50cc5c8a36cc5205e05ba4a69686dba481c WatchSource:0}: Error finding container e46954e79c1faca5ab39f4f0451ee50cc5c8a36cc5205e05ba4a69686dba481c: Status 404 returned error can't find the container with id e46954e79c1faca5ab39f4f0451ee50cc5c8a36cc5205e05ba4a69686dba481c
Sep 15 20:06:14.307292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:14.307253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" event={"ID":"5810f38d-fd4d-4dc0-a912-546a8cc2bd40","Type":"ContainerStarted","Data":"0654d9d17de1f62b9be6cc9480d8f7491365038b07d5b71c1e4d25ab3ee6da42"}
Sep 15 20:06:14.308665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:14.308634    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerStarted","Data":"e46954e79c1faca5ab39f4f0451ee50cc5c8a36cc5205e05ba4a69686dba481c"}
Sep 15 20:06:16.318298 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:16.318143    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mp956" event={"ID":"3522c6a5-691f-4a92-9eed-b4663b2e057c","Type":"ContainerStarted","Data":"f6f574daa1bd5cbefd3bf065678fc7cd0a8c0eafcad433444a65c0699f3f986c"}
Sep 15 20:06:16.318945 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:16.318909    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:06:16.338181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:16.338113    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mp956" podStartSLOduration=66.360706956 podStartE2EDuration="1m10.338088671s" totalImagesPullingTime="3.977381715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:06:16.337292705 +0000 UTC m=+70.782251716" watchObservedRunningTime="2026-09-15 20:06:16.338088671 +0000 UTC m=+70.783047681"
Sep 15 20:06:22.337836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.337750    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" event={"ID":"5810f38d-fd4d-4dc0-a912-546a8cc2bd40","Type":"ContainerStarted","Data":"a5f76201e10a169becbfc70e856ac6d06225594607c7667479bc39c2926d5146"}
Sep 15 20:06:22.337836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.337830    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:22.339629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.339597    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:06:22.340294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.340270    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerStarted","Data":"4758589532de742e7c8ad53b35706b6b52d0a3d39c14cef0e4caad47f8fc105f"}
Sep 15 20:06:22.340392 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.340309    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerStarted","Data":"8bd3ce57e5a45aa9ce711d9f8c4027728d8cb07f09520545b53aecec803bebb8"}
Sep 15 20:06:22.341864 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.341837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-x9gbq" event={"ID":"cdac05d3-89c4-4cac-a628-d8c27abd491d","Type":"ContainerStarted","Data":"5592f3fc705850c536ebc479380e1d5556b6773878a93d26befb5f122d73e708"}
Sep 15 20:06:22.372404 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.369959    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" podStartSLOduration=1.027092634 podStartE2EDuration="9.36994158s" totalImagesPullingTime="8.342848946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:06:22.354175727 +0000 UTC m=+76.799134735" watchObservedRunningTime="2026-09-15 20:06:22.36994158 +0000 UTC m=+76.814900585"
Sep 15 20:06:22.372404 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:22.370092    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-x9gbq" podStartSLOduration=66.490341653 podStartE2EDuration="1m16.370085233s" totalImagesPullingTime="9.87974358s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:06:22.368710354 +0000 UTC m=+76.813669362" watchObservedRunningTime="2026-09-15 20:06:22.370085233 +0000 UTC m=+76.815044241"
Sep 15 20:06:23.346955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:23.346910    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerStarted","Data":"16c594f05969142f93e45695a1920f458e77a1b867ee2cde49f2dec8ef77cc56"}
Sep 15 20:06:23.366509 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:23.366462    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" podStartSLOduration=1.9789881729999999 podStartE2EDuration="10.366446528s" totalImagesPullingTime="8.387458355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:06:23.366294975 +0000 UTC m=+77.811253983" watchObservedRunningTime="2026-09-15 20:06:23.366446528 +0000 UTC m=+77.811405535"
Sep 15 20:06:44.294571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:44.294421    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:06:44.294967 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:44.294588    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:06:44.294967 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:06:44.294669    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:07:48.294653083 +0000 UTC m=+162.739612069 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:06:48.327230 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:06:48.327201    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mp956"
Sep 15 20:07:15.714626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:07:15.714587    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:07:15.715141 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:15.714752    2554 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 15 20:07:15.715141 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:15.714825    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs podName:eae0f378-78d2-41d0-a359-668883a0cd11 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:17.714807873 +0000 UTC m=+252.159766858 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs") pod "network-metrics-daemon-9b7xr" (UID: "eae0f378-78d2-41d0-a359-668883a0cd11") : secret "metrics-daemon-secret" not found
Sep 15 20:07:43.432117 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:43.432063    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gpnkz" podUID="a6cae6c4-78ed-4d09-a44f-e065014477e7"
Sep 15 20:07:43.575254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:07:43.575222    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:07:44.037698 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:44.037640    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-9b7xr" podUID="eae0f378-78d2-41d0-a359-668883a0cd11"
Sep 15 20:07:48.344174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:07:48.344131    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:07:48.344764 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:48.344255    2554 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 20:07:48.344764 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:07:48.344307    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls podName:a6cae6c4-78ed-4d09-a44f-e065014477e7 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:50.344293823 +0000 UTC m=+284.789252809 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls") pod "dns-default-gpnkz" (UID: "a6cae6c4-78ed-4d09-a44f-e065014477e7") : secret "dns-default-metrics-tls" not found
Sep 15 20:07:55.017998 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:07:55.017944    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:08:22.338724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:22.338666    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" podUID="5810f38d-fd4d-4dc0-a912-546a8cc2bd40" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.8:8000/readyz\": dial tcp 10.134.0.8:8000: connect: connection refused"
Sep 15 20:08:22.688516 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:22.688481    2554 generic.go:356] "Generic (PLEG): container finished" podID="5810f38d-fd4d-4dc0-a912-546a8cc2bd40" containerID="a5f76201e10a169becbfc70e856ac6d06225594607c7667479bc39c2926d5146" exitCode=1
Sep 15 20:08:22.688683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:22.688543    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" event={"ID":"5810f38d-fd4d-4dc0-a912-546a8cc2bd40","Type":"ContainerDied","Data":"a5f76201e10a169becbfc70e856ac6d06225594607c7667479bc39c2926d5146"}
Sep 15 20:08:22.688850 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:22.688837    2554 scope.go:117] "RemoveContainer" containerID="a5f76201e10a169becbfc70e856ac6d06225594607c7667479bc39c2926d5146"
Sep 15 20:08:23.446077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:23.446037    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:08:23.693071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:23.693034    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2" event={"ID":"5810f38d-fd4d-4dc0-a912-546a8cc2bd40","Type":"ContainerStarted","Data":"7a2d8a774de8ef051bbca749b7e21768033957a32db71710f6f64d851657efa4"}
Sep 15 20:08:23.693276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:23.693254    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:08:23.693896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:23.693882    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-69f75899cc-w9tr2"
Sep 15 20:08:56.137513 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.137480    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xm77n"]
Sep 15 20:08:56.140536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.140517    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.144276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.144252    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 20:08:56.144393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.144277    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 20:08:56.144393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.144252    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 20:08:56.145141 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.145120    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 20:08:56.145141 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.145136    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8swwd\""
Sep 15 20:08:56.152566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.152540    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xm77n"]
Sep 15 20:08:56.203287 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.203241    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c24h2\" (UniqueName: \"kubernetes.io/projected/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-api-access-c24h2\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.203464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.203302    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.203464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.203338    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-crio-socket\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.203464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.203410    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.203464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.203461    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-data-volume\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.303832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.303795    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.303928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.303836    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-data-volume\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.303928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.303871    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c24h2\" (UniqueName: \"kubernetes.io/projected/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-api-access-c24h2\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.303928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.303894    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.303928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.303911    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-crio-socket\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.304102 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.303936    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:56.304102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.304008    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-crio-socket\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.304102 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.304033    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 20:08:56.304102 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.304038    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:56.804020789 +0000 UTC m=+231.248979777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:56.304241 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.304118    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:56.80410109 +0000 UTC m=+231.249060087 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : configmap "kube-rbac-proxy" not found
Sep 15 20:08:56.304241 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.304218    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-data-volume\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.313703 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.313678    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c24h2\" (UniqueName: \"kubernetes.io/projected/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-api-access-c24h2\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.808877 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.808839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.809086 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:56.808923    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:56.809086 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.809015    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:56.809086 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.809048    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 20:08:56.809086 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.809080    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:57.809064678 +0000 UTC m=+232.254023668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:56.809227 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:56.809116    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:57.809102525 +0000 UTC m=+232.254061510 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : configmap "kube-rbac-proxy" not found
Sep 15 20:08:57.815933 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:57.815890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:57.816443 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:57.815952    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:57.816443 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:57.816053    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 20:08:57.816443 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:57.816091    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:57.816443 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:57.816140    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:59.816118041 +0000 UTC m=+234.261077027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : configmap "kube-rbac-proxy" not found
Sep 15 20:08:57.816443 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:57.816160    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:08:59.816150277 +0000 UTC m=+234.261109263 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:57.866686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:57.866657    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhcsp_6015d577-ccef-4b0e-b044-555b6f100667/dns-node-resolver/0.log"
Sep 15 20:08:58.855876 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:58.855850    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx9gl_91a9d341-1103-4d6c-9672-f8454d43b179/node-ca/0.log"
Sep 15 20:08:59.832902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:59.832855    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:59.833087 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:08:59.832919    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:08:59.833087 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:59.833001    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 20:08:59.833087 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:59.833031    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:08:59.833087 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:59.833070    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:03.833053224 +0000 UTC m=+238.278012210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : configmap "kube-rbac-proxy" not found
Sep 15 20:08:59.833256 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:08:59.833103    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:03.833089757 +0000 UTC m=+238.278048743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:09:00.061969 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:00.061938    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxmzf_989a3f9f-1483-41c6-9523-eb28dca75372/serve-healthcheck-canary/0.log"
Sep 15 20:09:03.862323 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:03.862281    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:03.862713 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:03.862349    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:03.862713 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:03.862419    2554 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 15 20:09:03.862713 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:03.862440    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:09:03.862713 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:03.862473    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:11.862460169 +0000 UTC m=+246.307419155 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : configmap "kube-rbac-proxy" not found
Sep 15 20:09:03.862713 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:03.862495    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:11.86248258 +0000 UTC m=+246.307441570 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:09:11.922340 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:11.922300    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:11.922740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:11.922364    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:11.922740 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:11.922464    2554 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 20:09:11.922740 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:11.922556    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls podName:9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:27.922540655 +0000 UTC m=+262.367499641 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xm77n" (UID: "9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0") : secret "insights-runtime-extractor-tls" not found
Sep 15 20:09:11.922846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:11.922827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:17.769514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:17.769460    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:09:17.771829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:17.771804    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eae0f378-78d2-41d0-a359-668883a0cd11-metrics-certs\") pod \"network-metrics-daemon-9b7xr\" (UID: \"eae0f378-78d2-41d0-a359-668883a0cd11\") " pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:09:17.821854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:17.821824    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-l9zsw\""
Sep 15 20:09:17.829363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:17.829337    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-9b7xr"
Sep 15 20:09:18.100360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:18.100277    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-9b7xr"]
Sep 15 20:09:18.103061 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:18.103037    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeae0f378_78d2_41d0_a359_668883a0cd11.slice/crio-fb73f82f230af0dab8c4a50947971a1d5e5fb06dff0c4dcb8fb7edee75ff47cd WatchSource:0}: Error finding container fb73f82f230af0dab8c4a50947971a1d5e5fb06dff0c4dcb8fb7edee75ff47cd: Status 404 returned error can't find the container with id fb73f82f230af0dab8c4a50947971a1d5e5fb06dff0c4dcb8fb7edee75ff47cd
Sep 15 20:09:18.855564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:18.855528    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b7xr" event={"ID":"eae0f378-78d2-41d0-a359-668883a0cd11","Type":"ContainerStarted","Data":"fb73f82f230af0dab8c4a50947971a1d5e5fb06dff0c4dcb8fb7edee75ff47cd"}
Sep 15 20:09:19.864339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:19.864245    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b7xr" event={"ID":"eae0f378-78d2-41d0-a359-668883a0cd11","Type":"ContainerStarted","Data":"7290c859fd58a2551577fd99bd1c6fbe260acd41587909b457f85dfc3f746045"}
Sep 15 20:09:19.864339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:19.864331    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-9b7xr" event={"ID":"eae0f378-78d2-41d0-a359-668883a0cd11","Type":"ContainerStarted","Data":"ea4b185ae676af5ebb09d2015efda47ca77812bb01491d28b6f61082bafc0aa2"}
Sep 15 20:09:19.885738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:19.885682    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-9b7xr" podStartSLOduration=252.441855107 podStartE2EDuration="4m13.88566679s" totalImagesPullingTime="1.443811683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:05:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:19.8840986 +0000 UTC m=+254.329057609" watchObservedRunningTime="2026-09-15 20:09:19.88566679 +0000 UTC m=+254.330625798"
Sep 15 20:09:21.195390 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.195358    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-sm6c2"]
Sep 15 20:09:21.198175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.198158    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:21.201045 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.201012    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-gcjt6\""
Sep 15 20:09:21.201175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.201061    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 15 20:09:21.201175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.201061    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 15 20:09:21.212766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.212742    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-sm6c2"]
Sep 15 20:09:21.296166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.296113    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8n8h\" (UniqueName: \"kubernetes.io/projected/7e750dc6-f7cb-4be1-b7b9-95c7943c575c-kube-api-access-h8n8h\") pod \"downloads-76f99584f4-sm6c2\" (UID: \"7e750dc6-f7cb-4be1-b7b9-95c7943c575c\") " pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:21.397527 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.397483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8n8h\" (UniqueName: \"kubernetes.io/projected/7e750dc6-f7cb-4be1-b7b9-95c7943c575c-kube-api-access-h8n8h\") pod \"downloads-76f99584f4-sm6c2\" (UID: \"7e750dc6-f7cb-4be1-b7b9-95c7943c575c\") " pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:21.408827 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.408802    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8n8h\" (UniqueName: \"kubernetes.io/projected/7e750dc6-f7cb-4be1-b7b9-95c7943c575c-kube-api-access-h8n8h\") pod \"downloads-76f99584f4-sm6c2\" (UID: \"7e750dc6-f7cb-4be1-b7b9-95c7943c575c\") " pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:21.507134 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.507093    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:21.778460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.778385    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-sm6c2"]
Sep 15 20:09:21.781363 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:21.781330    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e750dc6_f7cb_4be1_b7b9_95c7943c575c.slice/crio-26273325f4578e2d6b799e29d24e301071e8a6a3b044b4f845fefd9976e1fc71 WatchSource:0}: Error finding container 26273325f4578e2d6b799e29d24e301071e8a6a3b044b4f845fefd9976e1fc71: Status 404 returned error can't find the container with id 26273325f4578e2d6b799e29d24e301071e8a6a3b044b4f845fefd9976e1fc71
Sep 15 20:09:21.872442 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:21.872403    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-sm6c2" event={"ID":"7e750dc6-f7cb-4be1-b7b9-95c7943c575c","Type":"ContainerStarted","Data":"26273325f4578e2d6b799e29d24e301071e8a6a3b044b4f845fefd9976e1fc71"}
Sep 15 20:09:27.949704 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:27.949655    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:27.952339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:27.952308    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xm77n\" (UID: \"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0\") " pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:28.251718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:28.251685    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8swwd\""
Sep 15 20:09:28.259870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:28.259836    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xm77n"
Sep 15 20:09:28.531896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:28.531818    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xm77n"]
Sep 15 20:09:28.535419 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:28.535388    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7f7aaa_7fd0_4cdf_aedc_29de4606aed0.slice/crio-86553085df2380fdde6223d1086fbb89284f402866564a62c526c998bb779a53 WatchSource:0}: Error finding container 86553085df2380fdde6223d1086fbb89284f402866564a62c526c998bb779a53: Status 404 returned error can't find the container with id 86553085df2380fdde6223d1086fbb89284f402866564a62c526c998bb779a53
Sep 15 20:09:28.896268 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:28.896172    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm77n" event={"ID":"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0","Type":"ContainerStarted","Data":"ab5a9d61d54a040f01e9dedfc522773c0df1c1f3f4afe6144d981b331e167000"}
Sep 15 20:09:28.896268 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:28.896242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm77n" event={"ID":"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0","Type":"ContainerStarted","Data":"86553085df2380fdde6223d1086fbb89284f402866564a62c526c998bb779a53"}
Sep 15 20:09:29.876095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.876061    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:09:29.879024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.879007    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:29.882912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.882888    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 15 20:09:29.883452 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.883430    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 15 20:09:29.883560 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.883538    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 15 20:09:29.883670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.883596    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 15 20:09:29.883731 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.883668    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-2kzkh\""
Sep 15 20:09:29.883915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.883897    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 15 20:09:29.895046 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.895016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:09:29.901725 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:29.901697    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm77n" event={"ID":"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0","Type":"ContainerStarted","Data":"ec7fc693fe09d3eab2637be33e72a1382170e613d7441a7696fd4ad18224c8f4"}
Sep 15 20:09:30.065389 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065343    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.065389 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065388    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.065616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065425    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.065616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm554\" (UniqueName: \"kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.065616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.065616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.065496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166015    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166071    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166103    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm554\" (UniqueName: \"kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166159    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.166947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166932    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.167121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.166932    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.168438 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.168422    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.168532 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.168515    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.174879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.174858    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm554\" (UniqueName: \"kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554\") pod \"console-6744f57564-6qzl5\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") " pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.187797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.187764    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:30.458059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.458021    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:09:30.462400 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:30.462372    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod533312df_4efc_4cc1_8229_a445ba1decde.slice/crio-128d6cb4c01bc22e7b81d4ed2511d1decc4431a3aebd69ae0155b78b33068d2f WatchSource:0}: Error finding container 128d6cb4c01bc22e7b81d4ed2511d1decc4431a3aebd69ae0155b78b33068d2f: Status 404 returned error can't find the container with id 128d6cb4c01bc22e7b81d4ed2511d1decc4431a3aebd69ae0155b78b33068d2f
Sep 15 20:09:30.906935 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:30.906846    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744f57564-6qzl5" event={"ID":"533312df-4efc-4cc1-8229-a445ba1decde","Type":"ContainerStarted","Data":"128d6cb4c01bc22e7b81d4ed2511d1decc4431a3aebd69ae0155b78b33068d2f"}
Sep 15 20:09:31.917067 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:31.916954    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xm77n" event={"ID":"9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0","Type":"ContainerStarted","Data":"3dc898c9852f7752d7c5fb8242afd25c2f7b7c4acdc7aabfc69764346a70a977"}
Sep 15 20:09:31.935500 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:31.935445    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xm77n" podStartSLOduration=33.131805085 podStartE2EDuration="35.935426605s" totalImagesPullingTime="2.80362152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:08:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:31.934118069 +0000 UTC m=+266.379077079" watchObservedRunningTime="2026-09-15 20:09:31.935426605 +0000 UTC m=+266.380385615"
Sep 15 20:09:34.929307 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:34.929274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744f57564-6qzl5" event={"ID":"533312df-4efc-4cc1-8229-a445ba1decde","Type":"ContainerStarted","Data":"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"}
Sep 15 20:09:34.948830 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:34.948773    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6744f57564-6qzl5" podStartSLOduration=1.63872273 podStartE2EDuration="5.948753509s" totalImagesPullingTime="4.310030779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:34.947513164 +0000 UTC m=+269.392472173" watchObservedRunningTime="2026-09-15 20:09:34.948753509 +0000 UTC m=+269.393712517"
Sep 15 20:09:36.293218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.293184    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-gkd5g"]
Sep 15 20:09:36.295716 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.295690    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.298554 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.298531    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 20:09:36.298694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.298583    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 20:09:36.298694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.298536    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 20:09:36.299752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.299689    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 20:09:36.299886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.299830    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 20:09:36.300217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.300053    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9jdsl\""
Sep 15 20:09:36.300217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.300162    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 20:09:36.316012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.315943    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-sys\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316003    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44mgv\" (UniqueName: \"kubernetes.io/projected/aca756c2-ee6f-4ea3-806a-cd3b172386db-kube-api-access-44mgv\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316221 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316076    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-root\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316221 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316185    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-accelerators-collector-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316332 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316234    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316332 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-textfile\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316332 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316324    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-wtmp\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316421    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.316537 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.316503    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-metrics-client-ca\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417119    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-textfile\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417161    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-wtmp\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417187    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417233    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-metrics-client-ca\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417271    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-sys\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417297    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44mgv\" (UniqueName: \"kubernetes.io/projected/aca756c2-ee6f-4ea3-806a-cd3b172386db-kube-api-access-44mgv\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417317    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-wtmp\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417381    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-root\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417321    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-root\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417424    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-accelerators-collector-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417454    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-textfile\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:36.417543    2554 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:36.417588    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls podName:aca756c2-ee6f-4ea3-806a-cd3b172386db nodeName:}" failed. No retries permitted until 2026-09-15 20:09:36.917570653 +0000 UTC m=+271.362529638 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls") pod "node-exporter-gkd5g" (UID: "aca756c2-ee6f-4ea3-806a-cd3b172386db") : secret "node-exporter-tls" not found
Sep 15 20:09:36.417770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.417598    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aca756c2-ee6f-4ea3-806a-cd3b172386db-sys\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.418148 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.418127    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-metrics-client-ca\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.418408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.418385    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-accelerators-collector-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.420102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.420078    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.429302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.429273    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44mgv\" (UniqueName: \"kubernetes.io/projected/aca756c2-ee6f-4ea3-806a-cd3b172386db-kube-api-access-44mgv\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.920197 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.920146    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:36.922932 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:36.922902    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aca756c2-ee6f-4ea3-806a-cd3b172386db-node-exporter-tls\") pod \"node-exporter-gkd5g\" (UID: \"aca756c2-ee6f-4ea3-806a-cd3b172386db\") " pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:37.207988 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:37.207946    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-gkd5g"
Sep 15 20:09:37.222083 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:37.222051    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca756c2_ee6f_4ea3_806a_cd3b172386db.slice/crio-2f36f0f22087622a875deb289bc87fcfa1f4802cc9643695db317edfdbbb6bae WatchSource:0}: Error finding container 2f36f0f22087622a875deb289bc87fcfa1f4802cc9643695db317edfdbbb6bae: Status 404 returned error can't find the container with id 2f36f0f22087622a875deb289bc87fcfa1f4802cc9643695db317edfdbbb6bae
Sep 15 20:09:37.942945 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:37.942905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gkd5g" event={"ID":"aca756c2-ee6f-4ea3-806a-cd3b172386db","Type":"ContainerStarted","Data":"2f36f0f22087622a875deb289bc87fcfa1f4802cc9643695db317edfdbbb6bae"}
Sep 15 20:09:38.949419 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:38.949317    2554 generic.go:356] "Generic (PLEG): container finished" podID="aca756c2-ee6f-4ea3-806a-cd3b172386db" containerID="6c317b7f314eef47bbd38b74e8906d6b05a85fe7c26b9599c265c5d1a5728b15" exitCode=0
Sep 15 20:09:38.949850 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:38.949426    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gkd5g" event={"ID":"aca756c2-ee6f-4ea3-806a-cd3b172386db","Type":"ContainerDied","Data":"6c317b7f314eef47bbd38b74e8906d6b05a85fe7c26b9599c265c5d1a5728b15"}
Sep 15 20:09:40.188351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:40.188309    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:40.188808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:40.188380    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:09:40.189968 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:40.189940    2554 patch_prober.go:28] interesting pod/console-6744f57564-6qzl5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused" start-of-body=
Sep 15 20:09:40.190124 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:40.190005    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6744f57564-6qzl5" podUID="533312df-4efc-4cc1-8229-a445ba1decde" containerName="console" probeResult="failure" output="Get \"https://10.134.0.12:8443/health\": dial tcp 10.134.0.12:8443: connect: connection refused"
Sep 15 20:09:41.116907 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.116871    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"]
Sep 15 20:09:41.121113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.121088    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:09:41.121294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.121268    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.124378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.124350    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-fwrwx\""
Sep 15 20:09:41.124523 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.124386    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Sep 15 20:09:41.137147 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.137110    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"]
Sep 15 20:09:41.148045 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.148010    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.148190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.148131    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m6tr\" (UniqueName: \"kubernetes.io/projected/d7043486-0da4-4266-9b59-18e51d04b308-kube-api-access-9m6tr\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.167894 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.167853    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:09:41.171475 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.171446    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.180160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.180136    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 15 20:09:41.183331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.183304    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:09:41.248770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.248729    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.248783    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m6tr\" (UniqueName: \"kubernetes.io/projected/d7043486-0da4-4266-9b59-18e51d04b308-kube-api-access-9m6tr\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.248811    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.248853    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.248927    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sf9lq\" (UniqueName: \"kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.249010    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.249069    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.249108    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.249164    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.249249 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:41.249196    2554 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Sep 15 20:09:41.249604 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:41.249262    2554 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert podName:d7043486-0da4-4266-9b59-18e51d04b308 nodeName:}" failed. No retries permitted until 2026-09-15 20:09:41.749240585 +0000 UTC m=+276.194199574 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert") pod "monitoring-plugin-5d85778b9d-mm7pg" (UID: "d7043486-0da4-4266-9b59-18e51d04b308") : secret "monitoring-plugin-cert" not found
Sep 15 20:09:41.259108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.259073    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m6tr\" (UniqueName: \"kubernetes.io/projected/d7043486-0da4-4266-9b59-18e51d04b308-kube-api-access-9m6tr\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.349886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.349848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.349905    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.349931    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.349954    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.350102    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sf9lq\" (UniqueName: \"kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350332 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.350148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.350332 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.350176    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.355696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.351123    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.355696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.351325    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.355696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.351443    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.355696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.351573    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.356548 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.356519    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.356655 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.356629    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.359266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.359239    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sf9lq\" (UniqueName: \"kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq\") pod \"console-7ffcbd9788-8ck8l\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") " pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.483021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.482964    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:41.526792 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.526754    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"]
Sep 15 20:09:41.529856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.529831    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.535004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.534966    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 15 20:09:41.535296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.535278    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 15 20:09:41.535637 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.535619    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-lfr2d\""
Sep 15 20:09:41.536395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.536372    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 15 20:09:41.536501 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.536376    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 15 20:09:41.536501 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.536401    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 15 20:09:41.541103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.541082    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 15 20:09:41.551345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-federate-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-serving-certs-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551410    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551433    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-metrics-client-ca\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551588 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551549    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551644    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551705 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.551751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.551709    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlxl4\" (UniqueName: \"kubernetes.io/projected/2df63b32-f27b-4f49-be48-fde18a818ba2-kube-api-access-qlxl4\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.555774 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.555752    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"]
Sep 15 20:09:41.652860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.652825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.652860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.652867    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.652898    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlxl4\" (UniqueName: \"kubernetes.io/projected/2df63b32-f27b-4f49-be48-fde18a818ba2-kube-api-access-qlxl4\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.652938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-federate-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.653000    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-serving-certs-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.653032    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.653060    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-metrics-client-ca\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.653110    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.653977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.653924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-trusted-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.654136 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.654088    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-metrics-client-ca\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.654339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.654291    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2df63b32-f27b-4f49-be48-fde18a818ba2-serving-certs-ca-bundle\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.656151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.656109    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-telemeter-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.656409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.656390    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-federate-client-tls\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.656538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.656519    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.656639 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.656617    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2df63b32-f27b-4f49-be48-fde18a818ba2-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.663586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.663552    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlxl4\" (UniqueName: \"kubernetes.io/projected/2df63b32-f27b-4f49-be48-fde18a818ba2-kube-api-access-qlxl4\") pod \"telemeter-client-76d96dfb5b-gr9g7\" (UID: \"2df63b32-f27b-4f49-be48-fde18a818ba2\") " pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:41.753734 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.753641    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.756545 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.756517    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d7043486-0da4-4266-9b59-18e51d04b308-monitoring-plugin-cert\") pod \"monitoring-plugin-5d85778b9d-mm7pg\" (UID: \"d7043486-0da4-4266-9b59-18e51d04b308\") " pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:41.841693 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:41.841647    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"
Sep 15 20:09:42.032252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:42.032159    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:45.978965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:45.978932    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gkd5g" event={"ID":"aca756c2-ee6f-4ea3-806a-cd3b172386db","Type":"ContainerStarted","Data":"406481470e68be85e1d9378f5526381a5222172cd7abdaae0487824db8793d74"}
Sep 15 20:09:46.094638 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.094389    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"]
Sep 15 20:09:46.097412 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:46.097381    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7043486_0da4_4266_9b59_18e51d04b308.slice/crio-94c39dc39de188c3bf0691185ba9ab83e87f924bd7565ee84c3266ac8d2c7476 WatchSource:0}: Error finding container 94c39dc39de188c3bf0691185ba9ab83e87f924bd7565ee84c3266ac8d2c7476: Status 404 returned error can't find the container with id 94c39dc39de188c3bf0691185ba9ab83e87f924bd7565ee84c3266ac8d2c7476
Sep 15 20:09:46.102311 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.102154    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:09:46.105414 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:46.105374    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bf75e7e_96ec_4663_84d0_e2be0a027a7f.slice/crio-5fdd0984fb79ed1f78f4ffa12e4f326741f0dd3f705a2c29578f01f1a555133d WatchSource:0}: Error finding container 5fdd0984fb79ed1f78f4ffa12e4f326741f0dd3f705a2c29578f01f1a555133d: Status 404 returned error can't find the container with id 5fdd0984fb79ed1f78f4ffa12e4f326741f0dd3f705a2c29578f01f1a555133d
Sep 15 20:09:46.107116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.107091    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7"]
Sep 15 20:09:46.108660 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:46.108632    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2df63b32_f27b_4f49_be48_fde18a818ba2.slice/crio-aac4da5ca4fad206f5b7613ea2dd0796d1ad2641f5680da6e693c1357c87e72d WatchSource:0}: Error finding container aac4da5ca4fad206f5b7613ea2dd0796d1ad2641f5680da6e693c1357c87e72d: Status 404 returned error can't find the container with id aac4da5ca4fad206f5b7613ea2dd0796d1ad2641f5680da6e693c1357c87e72d
Sep 15 20:09:46.576640 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:09:46.576595    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gpnkz" podUID="a6cae6c4-78ed-4d09-a44f-e065014477e7"
Sep 15 20:09:46.985464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.985354    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg" event={"ID":"d7043486-0da4-4266-9b59-18e51d04b308","Type":"ContainerStarted","Data":"94c39dc39de188c3bf0691185ba9ab83e87f924bd7565ee84c3266ac8d2c7476"}
Sep 15 20:09:46.988134 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.988097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-sm6c2" event={"ID":"7e750dc6-f7cb-4be1-b7b9-95c7943c575c","Type":"ContainerStarted","Data":"1be45424ad5c49a97962dd8e297fb460de90363ef977c91aee1300a0bc1a5093"}
Sep 15 20:09:46.989035 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.989011    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:46.992644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.992615    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-gkd5g" event={"ID":"aca756c2-ee6f-4ea3-806a-cd3b172386db","Type":"ContainerStarted","Data":"6fa56fa903ea2ef1533204d6791e8d6d9b87087045cec6e4e39910c869b6ed7c"}
Sep 15 20:09:46.995070 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.995041    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffcbd9788-8ck8l" event={"ID":"8bf75e7e-96ec-4663-84d0-e2be0a027a7f","Type":"ContainerStarted","Data":"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"}
Sep 15 20:09:46.995265 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.995097    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffcbd9788-8ck8l" event={"ID":"8bf75e7e-96ec-4663-84d0-e2be0a027a7f","Type":"ContainerStarted","Data":"5fdd0984fb79ed1f78f4ffa12e4f326741f0dd3f705a2c29578f01f1a555133d"}
Sep 15 20:09:46.996867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.996842    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:09:46.997109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:46.997034    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7" event={"ID":"2df63b32-f27b-4f49-be48-fde18a818ba2","Type":"ContainerStarted","Data":"aac4da5ca4fad206f5b7613ea2dd0796d1ad2641f5680da6e693c1357c87e72d"}
Sep 15 20:09:47.006293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:47.006250    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-sm6c2"
Sep 15 20:09:47.006870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:47.006770    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-sm6c2" podStartSLOduration=1.864242733 podStartE2EDuration="26.006752015s" totalImagesPullingTime="24.142509282s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:47.006575437 +0000 UTC m=+281.451534446" watchObservedRunningTime="2026-09-15 20:09:47.006752015 +0000 UTC m=+281.451711024"
Sep 15 20:09:47.030252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:47.030191    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-gkd5g" podStartSLOduration=9.573961515 podStartE2EDuration="11.030168729s" totalImagesPullingTime="1.385354248s" totalInitContainerRuntime="70.852966ms" isStatefulPod=true podCreationTimestamp="2026-09-15 20:09:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:47.028287909 +0000 UTC m=+281.473246918" watchObservedRunningTime="2026-09-15 20:09:47.030168729 +0000 UTC m=+281.475127738"
Sep 15 20:09:47.076109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:47.076044    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ffcbd9788-8ck8l" podStartSLOduration=6.07601927 podStartE2EDuration="6.07601927s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:47.074942274 +0000 UTC m=+281.519901272" watchObservedRunningTime="2026-09-15 20:09:47.07601927 +0000 UTC m=+281.520978275"
Sep 15 20:09:49.007503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:49.007459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg" event={"ID":"d7043486-0da4-4266-9b59-18e51d04b308","Type":"ContainerStarted","Data":"33544d9f1026684985e9345dfe0e8815325ab1d560ee12693562abfdeb63a068"}
Sep 15 20:09:49.007916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:49.007575    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:49.009112 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:49.009082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7" event={"ID":"2df63b32-f27b-4f49-be48-fde18a818ba2","Type":"ContainerStarted","Data":"1050802e6a03e07dd1358c73091afefe9da0f2ae544a188e377323f802ac14af"}
Sep 15 20:09:49.012880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:49.012855    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg"
Sep 15 20:09:49.026345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:49.026294    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5d85778b9d-mm7pg" podStartSLOduration=5.281558624 podStartE2EDuration="8.026282621s" totalImagesPullingTime="2.744723997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:49.024562081 +0000 UTC m=+283.469521091" watchObservedRunningTime="2026-09-15 20:09:49.026282621 +0000 UTC m=+283.471241628"
Sep 15 20:09:50.434764 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:50.434697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:09:50.438000 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:50.437949    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/a6cae6c4-78ed-4d09-a44f-e065014477e7-metrics-tls\") pod \"dns-default-gpnkz\" (UID: \"a6cae6c4-78ed-4d09-a44f-e065014477e7\") " pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:09:50.600727 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:50.600690    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jwzj9\""
Sep 15 20:09:50.608534 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:50.608460    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:09:50.965858 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:50.965822    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gpnkz"]
Sep 15 20:09:51.105137 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:51.105098    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6cae6c4_78ed_4d09_a44f_e065014477e7.slice/crio-03cb6a436988e5835c0cbbe2dc036f54127e3eccdfca7b433834c16f831bee3b WatchSource:0}: Error finding container 03cb6a436988e5835c0cbbe2dc036f54127e3eccdfca7b433834c16f831bee3b: Status 404 returned error can't find the container with id 03cb6a436988e5835c0cbbe2dc036f54127e3eccdfca7b433834c16f831bee3b
Sep 15 20:09:51.484215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:51.484133    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:51.484215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:51.484212    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:51.489643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:51.489616    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:52.024461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.024424    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpnkz" event={"ID":"a6cae6c4-78ed-4d09-a44f-e065014477e7","Type":"ContainerStarted","Data":"03cb6a436988e5835c0cbbe2dc036f54127e3eccdfca7b433834c16f831bee3b"}
Sep 15 20:09:52.028026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.027968    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7" event={"ID":"2df63b32-f27b-4f49-be48-fde18a818ba2","Type":"ContainerStarted","Data":"f98bbf2b732ec1e98f241124cdbdcbf8e54710da06a364f12357c24ca80228ac"}
Sep 15 20:09:52.028181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.028115    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7" event={"ID":"2df63b32-f27b-4f49-be48-fde18a818ba2","Type":"ContainerStarted","Data":"f5d6c061c51ed55bba8911b39f0eccb44344773326e6c99ee97b7cc5107beb4c"}
Sep 15 20:09:52.033667 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.033638    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:09:52.054851 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.054794    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-76d96dfb5b-gr9g7" podStartSLOduration=6.152011688 podStartE2EDuration="11.054767483s" totalImagesPullingTime="4.902755795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:52.052199925 +0000 UTC m=+286.497158933" watchObservedRunningTime="2026-09-15 20:09:52.054767483 +0000 UTC m=+286.499726492"
Sep 15 20:09:52.156158 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.156088    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:09:52.173078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.173041    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:09:52.173264 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.173169    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251232    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251291    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldxhd\" (UniqueName: \"kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251467    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251490    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.251686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.251516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352434    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352481    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352510    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldxhd\" (UniqueName: \"kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352590    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352614    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352635    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.352900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.352665    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.353369 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.353341    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.353720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.353688    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.353872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.353846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.354277 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.354250    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.355508 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.355468    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.355608 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.355545    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.362303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.362257    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldxhd\" (UniqueName: \"kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd\") pod \"console-5bcf6d5b69-xq996\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") " pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.486223 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.486183    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:09:52.801567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:52.801516    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:09:53.458832 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:09:53.458502    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f8b57a8_62b8_45c4_a51c_6032e228373b.slice/crio-ee1f135f1398c0c51d1d8849473b29a8ed614c60af836b30b5814161bf70df30 WatchSource:0}: Error finding container ee1f135f1398c0c51d1d8849473b29a8ed614c60af836b30b5814161bf70df30: Status 404 returned error can't find the container with id ee1f135f1398c0c51d1d8849473b29a8ed614c60af836b30b5814161bf70df30
Sep 15 20:09:54.052829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:54.052784    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcf6d5b69-xq996" event={"ID":"7f8b57a8-62b8-45c4-a51c-6032e228373b","Type":"ContainerStarted","Data":"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"}
Sep 15 20:09:54.053263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:54.052855    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcf6d5b69-xq996" event={"ID":"7f8b57a8-62b8-45c4-a51c-6032e228373b","Type":"ContainerStarted","Data":"ee1f135f1398c0c51d1d8849473b29a8ed614c60af836b30b5814161bf70df30"}
Sep 15 20:09:54.074678 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:54.074618    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bcf6d5b69-xq996" podStartSLOduration=2.074596796 podStartE2EDuration="2.074596796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:09:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:54.07378063 +0000 UTC m=+288.518739639" watchObservedRunningTime="2026-09-15 20:09:54.074596796 +0000 UTC m=+288.519555807"
Sep 15 20:09:55.059455 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:55.059411    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpnkz" event={"ID":"a6cae6c4-78ed-4d09-a44f-e065014477e7","Type":"ContainerStarted","Data":"0ec90d241330935ff3520a7f26808702085df29e95429a7ae6e108a19603f48c"}
Sep 15 20:09:55.059914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:55.059478    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gpnkz" event={"ID":"a6cae6c4-78ed-4d09-a44f-e065014477e7","Type":"ContainerStarted","Data":"e21311d4bd9ddc3d49e492cee88a80ac1a7bdad76e25213d738ee5a1a14edc64"}
Sep 15 20:09:55.079599 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:55.079535    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-gpnkz" podStartSLOduration=252.284076395 podStartE2EDuration="4m15.079512513s" totalImagesPullingTime="2.795436118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:05:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:09:55.077856519 +0000 UTC m=+289.522815529" watchObservedRunningTime="2026-09-15 20:09:55.079512513 +0000 UTC m=+289.524471521"
Sep 15 20:09:56.062809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:09:56.062775    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:10:02.487223 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:02.487191    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:10:02.487764 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:02.487267    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:10:02.491863 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:02.491835    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:10:03.090606 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:03.090579    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:10:03.141478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:03.141443    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:10:05.905633 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:05.905604    2554 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 20:10:06.069146 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.069111    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gpnkz"
Sep 15 20:10:06.144059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.143972    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6744f57564-6qzl5" podUID="533312df-4efc-4cc1-8229-a445ba1decde" containerName="console" containerID="cri-o://d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611" gracePeriod=15
Sep 15 20:10:06.404245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.404208    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:10:06.477642 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477609    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm554\" (UniqueName: \"kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.477843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477675    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.477843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477709    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.477843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477741    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.477843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477769    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.477843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.477805    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert\") pod \"533312df-4efc-4cc1-8229-a445ba1decde\" (UID: \"533312df-4efc-4cc1-8229-a445ba1decde\") "
Sep 15 20:10:06.478218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.478184    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config" (OuterVolumeSpecName: "console-config") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:06.478218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.478212    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca" (OuterVolumeSpecName: "service-ca") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:06.478372 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.478244    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:06.480278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.480249    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554" (OuterVolumeSpecName: "kube-api-access-dm554") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "kube-api-access-dm554". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:10:06.480371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.480288    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:10:06.480371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.480311    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "533312df-4efc-4cc1-8229-a445ba1decde" (UID: "533312df-4efc-4cc1-8229-a445ba1decde"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:10:06.578632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578596    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:06.578632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578625    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-oauth-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:06.578632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578635    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm554\" (UniqueName: \"kubernetes.io/projected/533312df-4efc-4cc1-8229-a445ba1decde-kube-api-access-dm554\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:06.578632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578643    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-oauth-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:06.578926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578652    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/533312df-4efc-4cc1-8229-a445ba1decde-console-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:06.578926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:06.578660    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/533312df-4efc-4cc1-8229-a445ba1decde-console-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:07.101398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.101352    2554 generic.go:356] "Generic (PLEG): container finished" podID="533312df-4efc-4cc1-8229-a445ba1decde" containerID="d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611" exitCode=0
Sep 15 20:10:07.101868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.101450    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6744f57564-6qzl5"
Sep 15 20:10:07.101868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.101442    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744f57564-6qzl5" event={"ID":"533312df-4efc-4cc1-8229-a445ba1decde","Type":"ContainerDied","Data":"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"}
Sep 15 20:10:07.101868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.101572    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6744f57564-6qzl5" event={"ID":"533312df-4efc-4cc1-8229-a445ba1decde","Type":"ContainerDied","Data":"128d6cb4c01bc22e7b81d4ed2511d1decc4431a3aebd69ae0155b78b33068d2f"}
Sep 15 20:10:07.101868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.101601    2554 scope.go:117] "RemoveContainer" containerID="d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"
Sep 15 20:10:07.110151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.110126    2554 scope.go:117] "RemoveContainer" containerID="d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"
Sep 15 20:10:07.110493 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:10:07.110471    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611\": container with ID starting with d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611 not found: ID does not exist" containerID="d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"
Sep 15 20:10:07.110565 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.110508    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611"} err="failed to get container status \"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611\": rpc error: code = NotFound desc = could not find container \"d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611\": container with ID starting with d25a49fdc5e83c9f24c734187d4a3d3c9f2ba2d74317847417f534f68a584611 not found: ID does not exist"
Sep 15 20:10:07.143086 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.143051    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:10:07.156920 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:07.156886    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6744f57564-6qzl5"]
Sep 15 20:10:08.023171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:08.023136    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="533312df-4efc-4cc1-8229-a445ba1decde" path="/var/lib/kubelet/pods/533312df-4efc-4cc1-8229-a445ba1decde/volumes"
Sep 15 20:10:13.464160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:13.464123    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" podUID="d290ee1e-0f79-495d-b790-a260290ad040" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 20:10:23.463721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:23.463674    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" podUID="d290ee1e-0f79-495d-b790-a260290ad040" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 20:10:28.160724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.160668    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ffcbd9788-8ck8l" podUID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" containerName="console" containerID="cri-o://905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301" gracePeriod=15
Sep 15 20:10:28.437831 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.437753    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:10:28.550482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550443    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sf9lq\" (UniqueName: \"kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550499    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550530    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550632    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550678    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550722    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.550900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.550744    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle\") pod \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\" (UID: \"8bf75e7e-96ec-4663-84d0-e2be0a027a7f\") "
Sep 15 20:10:28.551064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.551040    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config" (OuterVolumeSpecName: "console-config") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:28.551127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.551061    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca" (OuterVolumeSpecName: "service-ca") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:28.551240 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.551213    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:28.551305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.551260    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:10:28.552648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.552624    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq" (OuterVolumeSpecName: "kube-api-access-sf9lq") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "kube-api-access-sf9lq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:10:28.552752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.552724    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:10:28.552792 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.552746    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8bf75e7e-96ec-4663-84d0-e2be0a027a7f" (UID: "8bf75e7e-96ec-4663-84d0-e2be0a027a7f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:10:28.651317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651280    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651310    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651319    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651328    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-oauth-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651336    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-console-oauth-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651346    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-trusted-ca-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:28.651609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:28.651356    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sf9lq\" (UniqueName: \"kubernetes.io/projected/8bf75e7e-96ec-4663-84d0-e2be0a027a7f-kube-api-access-sf9lq\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:10:29.184355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.184312    2554 generic.go:356] "Generic (PLEG): container finished" podID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" containerID="905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301" exitCode=0
Sep 15 20:10:29.184752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.184362    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ffcbd9788-8ck8l"
Sep 15 20:10:29.184752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.184361    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffcbd9788-8ck8l" event={"ID":"8bf75e7e-96ec-4663-84d0-e2be0a027a7f","Type":"ContainerDied","Data":"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"}
Sep 15 20:10:29.184752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.184481    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ffcbd9788-8ck8l" event={"ID":"8bf75e7e-96ec-4663-84d0-e2be0a027a7f","Type":"ContainerDied","Data":"5fdd0984fb79ed1f78f4ffa12e4f326741f0dd3f705a2c29578f01f1a555133d"}
Sep 15 20:10:29.184752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.184508    2554 scope.go:117] "RemoveContainer" containerID="905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"
Sep 15 20:10:29.193074 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.193057    2554 scope.go:117] "RemoveContainer" containerID="905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"
Sep 15 20:10:29.193358 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:10:29.193337    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301\": container with ID starting with 905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301 not found: ID does not exist" containerID="905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"
Sep 15 20:10:29.193444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.193364    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301"} err="failed to get container status \"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301\": rpc error: code = NotFound desc = could not find container \"905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301\": container with ID starting with 905cf75f4f9bd2572beeab438ee1d7798859249fcd94856add6fad1e7832a301 not found: ID does not exist"
Sep 15 20:10:29.206733 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.206705    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:10:29.208631 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:29.208602    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ffcbd9788-8ck8l"]
Sep 15 20:10:30.022398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:30.022365    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" path="/var/lib/kubelet/pods/8bf75e7e-96ec-4663-84d0-e2be0a027a7f/volumes"
Sep 15 20:10:33.463736 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:33.463694    2554 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" podUID="d290ee1e-0f79-495d-b790-a260290ad040" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
Sep 15 20:10:33.464250 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:33.463774    2554 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59"
Sep 15 20:10:33.464250 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:33.464232    2554 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"16c594f05969142f93e45695a1920f458e77a1b867ee2cde49f2dec8ef77cc56"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" containerMessage="Container service-proxy failed liveness probe, will be restarted"
Sep 15 20:10:33.464321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:33.464268    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" podUID="d290ee1e-0f79-495d-b790-a260290ad040" containerName="service-proxy" containerID="cri-o://16c594f05969142f93e45695a1920f458e77a1b867ee2cde49f2dec8ef77cc56" gracePeriod=30
Sep 15 20:10:34.212110 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:34.212078    2554 generic.go:356] "Generic (PLEG): container finished" podID="d290ee1e-0f79-495d-b790-a260290ad040" containerID="16c594f05969142f93e45695a1920f458e77a1b867ee2cde49f2dec8ef77cc56" exitCode=2
Sep 15 20:10:34.212275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:34.212142    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerDied","Data":"16c594f05969142f93e45695a1920f458e77a1b867ee2cde49f2dec8ef77cc56"}
Sep 15 20:10:34.212275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:10:34.212190    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-7d4b75fc67-wxw59" event={"ID":"d290ee1e-0f79-495d-b790-a260290ad040","Type":"ContainerStarted","Data":"b2cb43b5d13ab7301edd222beea16cb693da012fb224d73157a1649b29403a80"}
Sep 15 20:11:20.357974 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.357938    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358194    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="533312df-4efc-4cc1-8229-a445ba1decde" containerName="console"
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358207    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="533312df-4efc-4cc1-8229-a445ba1decde" containerName="console"
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358215    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" containerName="console"
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358220    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" containerName="console"
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358271    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="533312df-4efc-4cc1-8229-a445ba1decde" containerName="console"
Sep 15 20:11:20.358394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.358279    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8bf75e7e-96ec-4663-84d0-e2be0a027a7f" containerName="console"
Sep 15 20:11:20.362304 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.362287    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.372398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.372370    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:11:20.425583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425538    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9j7sf\" (UniqueName: \"kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425583    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425613    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425649    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425718    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425754    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.425788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.425781    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.526867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.526829    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.526867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.526868    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.526891    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527025    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9j7sf\" (UniqueName: \"kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527135 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527069    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527135 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527151    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527667    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527817 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527723    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527862 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527812    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.527900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.527861    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.529553 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.529521    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.529712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.529692    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.535395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.535372    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9j7sf\" (UniqueName: \"kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf\") pod \"console-7974dfcc7b-jm4wf\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") " pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.672350 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.672250    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:20.944732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:20.944646    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:11:20.948007 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:11:20.947962    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14cd0f9_d67e_4332_a774_b1bb31defe03.slice/crio-c78ea1047bb9030345506712e4b0d85b02d67fbd52668456fe3f938938fcc877 WatchSource:0}: Error finding container c78ea1047bb9030345506712e4b0d85b02d67fbd52668456fe3f938938fcc877: Status 404 returned error can't find the container with id c78ea1047bb9030345506712e4b0d85b02d67fbd52668456fe3f938938fcc877
Sep 15 20:11:21.379684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:21.379649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974dfcc7b-jm4wf" event={"ID":"f14cd0f9-d67e-4332-a774-b1bb31defe03","Type":"ContainerStarted","Data":"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"}
Sep 15 20:11:21.380111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:21.379698    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974dfcc7b-jm4wf" event={"ID":"f14cd0f9-d67e-4332-a774-b1bb31defe03","Type":"ContainerStarted","Data":"c78ea1047bb9030345506712e4b0d85b02d67fbd52668456fe3f938938fcc877"}
Sep 15 20:11:21.398917 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:21.398865    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7974dfcc7b-jm4wf" podStartSLOduration=1.398847891 podStartE2EDuration="1.398847891s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:11:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:11:21.397630297 +0000 UTC m=+375.842589309" watchObservedRunningTime="2026-09-15 20:11:21.398847891 +0000 UTC m=+375.843806899"
Sep 15 20:11:30.673477 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:30.673430    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:30.673894 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:30.673538    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:30.678256 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:30.678230    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:31.421072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:31.421041    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:11:31.472155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:31.472126    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:11:56.491478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.491422    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bcf6d5b69-xq996" podUID="7f8b57a8-62b8-45c4-a51c-6032e228373b" containerName="console" containerID="cri-o://6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47" gracePeriod=15
Sep 15 20:11:56.737976 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.737948    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:11:56.893451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893363    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893419    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893442    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893561    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893601    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ldxhd\" (UniqueName: \"kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893626    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893672    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle\") pod \"7f8b57a8-62b8-45c4-a51c-6032e228373b\" (UID: \"7f8b57a8-62b8-45c4-a51c-6032e228373b\") "
Sep 15 20:11:56.893895 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893833    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca" (OuterVolumeSpecName: "service-ca") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:11:56.893895 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893845    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:11:56.894021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893939    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config" (OuterVolumeSpecName: "console-config") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:11:56.894021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893954    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-oauth-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.894021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.893973    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.894224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.894201    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:11:56.895564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.895541    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:11:56.895727 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.895708    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd" (OuterVolumeSpecName: "kube-api-access-ldxhd") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "kube-api-access-ldxhd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:11:56.895776 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.895752    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7f8b57a8-62b8-45c4-a51c-6032e228373b" (UID: "7f8b57a8-62b8-45c4-a51c-6032e228373b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:11:56.994570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.994529    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-trusted-ca-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.994570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.994562    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.994570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.994572    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.994842 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.994582    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ldxhd\" (UniqueName: \"kubernetes.io/projected/7f8b57a8-62b8-45c4-a51c-6032e228373b-kube-api-access-ldxhd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:56.994842 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:56.994594    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7f8b57a8-62b8-45c4-a51c-6032e228373b-console-oauth-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:11:57.511444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.511409    2554 generic.go:356] "Generic (PLEG): container finished" podID="7f8b57a8-62b8-45c4-a51c-6032e228373b" containerID="6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47" exitCode=0
Sep 15 20:11:57.511902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.511468    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bcf6d5b69-xq996"
Sep 15 20:11:57.511902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.511503    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcf6d5b69-xq996" event={"ID":"7f8b57a8-62b8-45c4-a51c-6032e228373b","Type":"ContainerDied","Data":"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"}
Sep 15 20:11:57.511902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.511565    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bcf6d5b69-xq996" event={"ID":"7f8b57a8-62b8-45c4-a51c-6032e228373b","Type":"ContainerDied","Data":"ee1f135f1398c0c51d1d8849473b29a8ed614c60af836b30b5814161bf70df30"}
Sep 15 20:11:57.511902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.511600    2554 scope.go:117] "RemoveContainer" containerID="6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"
Sep 15 20:11:57.520320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.520299    2554 scope.go:117] "RemoveContainer" containerID="6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"
Sep 15 20:11:57.520660 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:11:57.520641    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47\": container with ID starting with 6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47 not found: ID does not exist" containerID="6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"
Sep 15 20:11:57.520708 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.520671    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47"} err="failed to get container status \"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47\": rpc error: code = NotFound desc = could not find container \"6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47\": container with ID starting with 6b9dd8ea4816dcb459303ed3c8203eaf91c83269536d4f3f89e53d8e02d22b47 not found: ID does not exist"
Sep 15 20:11:57.535066 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.535024    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:11:57.538717 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:57.538688    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bcf6d5b69-xq996"]
Sep 15 20:11:58.022048 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:11:58.022014    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f8b57a8-62b8-45c4-a51c-6032e228373b" path="/var/lib/kubelet/pods/7f8b57a8-62b8-45c4-a51c-6032e228373b/volumes"
Sep 15 20:12:37.515415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.515328    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffms5"]
Sep 15 20:12:37.515967 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.515677    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f8b57a8-62b8-45c4-a51c-6032e228373b" containerName="console"
Sep 15 20:12:37.515967 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.515696    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f8b57a8-62b8-45c4-a51c-6032e228373b" containerName="console"
Sep 15 20:12:37.515967 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.515766    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f8b57a8-62b8-45c4-a51c-6032e228373b" containerName="console"
Sep 15 20:12:37.518541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.518521    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.521065 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.521041    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 15 20:12:37.521152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.521045    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 15 20:12:37.521882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.521867    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-2qqkx\""
Sep 15 20:12:37.527516 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.527493    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffms5"]
Sep 15 20:12:37.581517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.581475    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.581517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.581526    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sws8r\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-kube-api-access-sws8r\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.682453 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.682409    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sws8r\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-kube-api-access-sws8r\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.682615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.682483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.690757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.690720    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-bound-sa-token\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.690878 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.690853    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sws8r\" (UniqueName: \"kubernetes.io/projected/1166e727-a0de-4c04-bd24-6ef39f937059-kube-api-access-sws8r\") pod \"cert-manager-55b4d954d5-ffms5\" (UID: \"1166e727-a0de-4c04-bd24-6ef39f937059\") " pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:37.827822 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:37.827732    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ffms5"
Sep 15 20:12:38.099801 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:38.099775    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ffms5"]
Sep 15 20:12:38.102541 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:12:38.102512    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1166e727_a0de_4c04_bd24_6ef39f937059.slice/crio-4b71422f2ea6ec7db04d2d267e61c01c6cdcaacc94cb42c9229efc6769f62190 WatchSource:0}: Error finding container 4b71422f2ea6ec7db04d2d267e61c01c6cdcaacc94cb42c9229efc6769f62190: Status 404 returned error can't find the container with id 4b71422f2ea6ec7db04d2d267e61c01c6cdcaacc94cb42c9229efc6769f62190
Sep 15 20:12:38.104640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:38.104622    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 20:12:38.654852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:38.654805    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ffms5" event={"ID":"1166e727-a0de-4c04-bd24-6ef39f937059","Type":"ContainerStarted","Data":"4b71422f2ea6ec7db04d2d267e61c01c6cdcaacc94cb42c9229efc6769f62190"}
Sep 15 20:12:41.668938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:41.668896    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ffms5" event={"ID":"1166e727-a0de-4c04-bd24-6ef39f937059","Type":"ContainerStarted","Data":"b92b6516d394d9028a4369efee76527c77293ad1513862a87363159d9c6054fd"}
Sep 15 20:12:41.686099 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:12:41.686042    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ffms5" podStartSLOduration=1.9131804460000001 podStartE2EDuration="4.686019836s" totalImagesPullingTime="2.77283939s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:12:41.684893711 +0000 UTC m=+456.129852719" watchObservedRunningTime="2026-09-15 20:12:41.686019836 +0000 UTC m=+456.130978844"
Sep 15 20:13:04.416963 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.416923    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"]
Sep 15 20:13:04.420078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.420055    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.422849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.422820    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 20:13:04.423012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.422825    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d6xtv\""
Sep 15 20:13:04.423012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.422825    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 20:13:04.423012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.422851    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 20:13:04.423012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.422880    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 20:13:04.438197 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.438165    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"]
Sep 15 20:13:04.484914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.484869    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.484914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.484922    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-tmp\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.485143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.484996    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-manifests\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.485143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.485026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbhzc\" (UniqueName: \"kubernetes.io/projected/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-kube-api-access-hbhzc\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.485143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.485070    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586141 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586087    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-tmp\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586141 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-manifests\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbhzc\" (UniqueName: \"kubernetes.io/projected/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-kube-api-access-hbhzc\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586202    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586249    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.586637 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.586613    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-manifests\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.588592 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.588566    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-tmp\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.588700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.588653    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-webhook-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.588762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.588728    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.603903 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.603867    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbhzc\" (UniqueName: \"kubernetes.io/projected/b4d0b552-e96c-45b9-a4cc-362bf8f671b9-kube-api-access-hbhzc\") pod \"opendatahub-operator-controller-manager-75fcf566-6j8wd\" (UID: \"b4d0b552-e96c-45b9-a4cc-362bf8f671b9\") " pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:04.730644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:04.730610    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:05.014855 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:05.014821    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"]
Sep 15 20:13:05.017340 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:13:05.017310    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d0b552_e96c_45b9_a4cc_362bf8f671b9.slice/crio-243972109a28d13c88d5cf80e2896af22f690d4be04dad9023b3bb0faacb24f2 WatchSource:0}: Error finding container 243972109a28d13c88d5cf80e2896af22f690d4be04dad9023b3bb0faacb24f2: Status 404 returned error can't find the container with id 243972109a28d13c88d5cf80e2896af22f690d4be04dad9023b3bb0faacb24f2
Sep 15 20:13:05.757390 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:05.757351    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd" event={"ID":"b4d0b552-e96c-45b9-a4cc-362bf8f671b9","Type":"ContainerStarted","Data":"243972109a28d13c88d5cf80e2896af22f690d4be04dad9023b3bb0faacb24f2"}
Sep 15 20:13:08.771715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:08.771673    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd" event={"ID":"b4d0b552-e96c-45b9-a4cc-362bf8f671b9","Type":"ContainerStarted","Data":"1e48ee86a805b90e8db8f3501cbe54b8fd356e3f45aa3679bc2f559d8a30054c"}
Sep 15 20:13:09.778054 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:09.778017    2554 generic.go:356] "Generic (PLEG): container finished" podID="b4d0b552-e96c-45b9-a4cc-362bf8f671b9" containerID="1e48ee86a805b90e8db8f3501cbe54b8fd356e3f45aa3679bc2f559d8a30054c" exitCode=0
Sep 15 20:13:09.778428 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:09.778090    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd" event={"ID":"b4d0b552-e96c-45b9-a4cc-362bf8f671b9","Type":"ContainerDied","Data":"1e48ee86a805b90e8db8f3501cbe54b8fd356e3f45aa3679bc2f559d8a30054c"}
Sep 15 20:13:10.784811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:10.784772    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd" event={"ID":"b4d0b552-e96c-45b9-a4cc-362bf8f671b9","Type":"ContainerStarted","Data":"e7ebe1f151a6eb97d40872d41cb5299947fd6a6a99fa1b422c19776f95cd6666"}
Sep 15 20:13:10.785258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:10.784909    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:10.807749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:10.807693    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd" podStartSLOduration=2.046271134 podStartE2EDuration="6.807675563s" totalImagesPullingTime="3.683508387s" totalInitContainerRuntime="1.077896042s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:13:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:13:10.806250554 +0000 UTC m=+485.251209561" watchObservedRunningTime="2026-09-15 20:13:10.807675563 +0000 UTC m=+485.252634571"
Sep 15 20:13:21.791205 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:21.791173    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-75fcf566-6j8wd"
Sep 15 20:13:23.038658 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.038622    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"]
Sep 15 20:13:23.047730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.047702    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.050745 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.050714    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 20:13:23.050976 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.050757    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 20:13:23.050976 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.050816    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 20:13:23.051308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.051285    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"]
Sep 15 20:13:23.051528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.051513    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-hcvps\""
Sep 15 20:13:23.051615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.051565    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 20:13:23.051672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.051652    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 20:13:23.143231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.143194    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-metrics-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.143231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.143245    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwm57\" (UniqueName: \"kubernetes.io/projected/677fd82d-0247-464b-bb8f-a749717367fb-kube-api-access-qwm57\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.143488 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.143328    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/677fd82d-0247-464b-bb8f-a749717367fb-manager-config\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.143488 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.143384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.244584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.244538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/677fd82d-0247-464b-bb8f-a749717367fb-manager-config\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.244584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.244582    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.244808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.244623    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-metrics-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.244808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.244646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwm57\" (UniqueName: \"kubernetes.io/projected/677fd82d-0247-464b-bb8f-a749717367fb-kube-api-access-qwm57\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.245351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.245317    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/677fd82d-0247-464b-bb8f-a749717367fb-manager-config\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.247179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.247158    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.247293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.247203    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/677fd82d-0247-464b-bb8f-a749717367fb-metrics-cert\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.252837 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.252813    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwm57\" (UniqueName: \"kubernetes.io/projected/677fd82d-0247-464b-bb8f-a749717367fb-kube-api-access-qwm57\") pod \"lws-controller-manager-d95cdffcd-98bpr\" (UID: \"677fd82d-0247-464b-bb8f-a749717367fb\") " pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.358274 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.358185    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:23.628242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.628216    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"]
Sep 15 20:13:23.630892 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:13:23.630859    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod677fd82d_0247_464b_bb8f_a749717367fb.slice/crio-d7ccb217f416381cfdd01fa9e8d2e1794240de9b810ea34312867d82a8f264c9 WatchSource:0}: Error finding container d7ccb217f416381cfdd01fa9e8d2e1794240de9b810ea34312867d82a8f264c9: Status 404 returned error can't find the container with id d7ccb217f416381cfdd01fa9e8d2e1794240de9b810ea34312867d82a8f264c9
Sep 15 20:13:23.835782 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:23.835747    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr" event={"ID":"677fd82d-0247-464b-bb8f-a749717367fb","Type":"ContainerStarted","Data":"d7ccb217f416381cfdd01fa9e8d2e1794240de9b810ea34312867d82a8f264c9"}
Sep 15 20:13:26.850828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:26.850791    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr" event={"ID":"677fd82d-0247-464b-bb8f-a749717367fb","Type":"ContainerStarted","Data":"f4c8c1ad34d33f860dbb24c24851c629e4015c931fa18e85733ddbea2a3b6e2f"}
Sep 15 20:13:26.851209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:26.850865    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:26.869583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:26.869523    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr" podStartSLOduration=1.101359844 podStartE2EDuration="3.869503645s" totalImagesPullingTime="2.768143801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:13:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:13:26.868581526 +0000 UTC m=+501.313540540" watchObservedRunningTime="2026-09-15 20:13:26.869503645 +0000 UTC m=+501.314462727"
Sep 15 20:13:37.856734 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:37.856706    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-d95cdffcd-98bpr"
Sep 15 20:13:42.608132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.608096    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"]
Sep 15 20:13:42.616927 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.616900    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.619972 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.619949    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 20:13:42.620125 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.620066    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 20:13:42.620279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.620263    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 20:13:42.620343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.620294    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 20:13:42.620395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.620350    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 20:13:42.620395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.620393    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 20:13:42.623195 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.623176    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-d5rk6\""
Sep 15 20:13:42.636570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.636541    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"]
Sep 15 20:13:42.705246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705213    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705251    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bb0cf94-2ec7-449d-bbc3-8456435634f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705279    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705313    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djhsh\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-kube-api-access-djhsh\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705393    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.705482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.705430    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.805791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805747    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.805791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805814    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-djhsh\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-kube-api-access-djhsh\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805846    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805879    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.805933    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bb0cf94-2ec7-449d-bbc3-8456435634f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.806911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.806881    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.808426 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.808390    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.808718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.808687    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/8bb0cf94-2ec7-449d-bbc3-8456435634f5-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.808820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.808716    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.808861 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.808830    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.823872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.823846    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.825328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.825304    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-djhsh\" (UniqueName: \"kubernetes.io/projected/8bb0cf94-2ec7-449d-bbc3-8456435634f5-kube-api-access-djhsh\") pod \"istiod-openshift-gateway-5677ccb49b-vbprg\" (UID: \"8bb0cf94-2ec7-449d-bbc3-8456435634f5\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:42.926781 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:42.926696    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:43.203569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:43.203454    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"]
Sep 15 20:13:43.206147 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:13:43.206115    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bb0cf94_2ec7_449d_bbc3_8456435634f5.slice/crio-99f0e6b4793f25d3e2442d244032f22ce438003ad109db6dd630200fd8a809f3 WatchSource:0}: Error finding container 99f0e6b4793f25d3e2442d244032f22ce438003ad109db6dd630200fd8a809f3: Status 404 returned error can't find the container with id 99f0e6b4793f25d3e2442d244032f22ce438003ad109db6dd630200fd8a809f3
Sep 15 20:13:43.925501 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:43.925456    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg" event={"ID":"8bb0cf94-2ec7-449d-bbc3-8456435634f5","Type":"ContainerStarted","Data":"99f0e6b4793f25d3e2442d244032f22ce438003ad109db6dd630200fd8a809f3"}
Sep 15 20:13:45.442724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:45.442682    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:13:45.443032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:45.442756    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:13:45.938194 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:45.938153    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg" event={"ID":"8bb0cf94-2ec7-449d-bbc3-8456435634f5","Type":"ContainerStarted","Data":"ed69c7c6f63ec66b3688eadf9c2ee457720484c933dffe3bb3878b55c171ea0c"}
Sep 15 20:13:45.938385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:45.938261    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:13:45.972355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:45.972292    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg" podStartSLOduration=1.738136285 podStartE2EDuration="3.972269956s" totalImagesPullingTime="2.234133671s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:13:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:13:45.969307821 +0000 UTC m=+520.414266829" watchObservedRunningTime="2026-09-15 20:13:45.972269956 +0000 UTC m=+520.417228964"
Sep 15 20:13:46.944468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:13:46.944439    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-vbprg"
Sep 15 20:14:48.603402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:14:48.603362    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:15:13.622772 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.622727    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7974dfcc7b-jm4wf" podUID="f14cd0f9-d67e-4332-a774-b1bb31defe03" containerName="console" containerID="cri-o://8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf" gracePeriod=15
Sep 15 20:15:13.873440 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.873385    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:15:13.908735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908699    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.908735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908743    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9j7sf\" (UniqueName: \"kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.908958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908778    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.908958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908798    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.908958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908918    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.909143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.908974    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.909143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.909036    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert\") pod \"f14cd0f9-d67e-4332-a774-b1bb31defe03\" (UID: \"f14cd0f9-d67e-4332-a774-b1bb31defe03\") "
Sep 15 20:15:13.909286 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.909172    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca" (OuterVolumeSpecName: "service-ca") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:15:13.909494 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.909460    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:15:13.909629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.909469    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config" (OuterVolumeSpecName: "console-config") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:15:13.909629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.909569    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:15:13.911079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.911057    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:15:13.911171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.911101    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:15:13.911212 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:13.911172    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf" (OuterVolumeSpecName: "kube-api-access-9j7sf") pod "f14cd0f9-d67e-4332-a774-b1bb31defe03" (UID: "f14cd0f9-d67e-4332-a774-b1bb31defe03"). InnerVolumeSpecName "kube-api-access-9j7sf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:15:14.010410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010368    2554 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-oauth-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010404    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9j7sf\" (UniqueName: \"kubernetes.io/projected/f14cd0f9-d67e-4332-a774-b1bb31defe03-kube-api-access-9j7sf\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010410 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010414    2554 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010423    2554 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010434    2554 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-trusted-ca-bundle\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010443    2554 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-console-config\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.010649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.010451    2554 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f14cd0f9-d67e-4332-a774-b1bb31defe03-oauth-serving-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:15:14.269965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.269925    2554 generic.go:356] "Generic (PLEG): container finished" podID="f14cd0f9-d67e-4332-a774-b1bb31defe03" containerID="8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf" exitCode=0
Sep 15 20:15:14.270159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.270015    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7974dfcc7b-jm4wf"
Sep 15 20:15:14.270159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.270030    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974dfcc7b-jm4wf" event={"ID":"f14cd0f9-d67e-4332-a774-b1bb31defe03","Type":"ContainerDied","Data":"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"}
Sep 15 20:15:14.270159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.270128    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7974dfcc7b-jm4wf" event={"ID":"f14cd0f9-d67e-4332-a774-b1bb31defe03","Type":"ContainerDied","Data":"c78ea1047bb9030345506712e4b0d85b02d67fbd52668456fe3f938938fcc877"}
Sep 15 20:15:14.270159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.270152    2554 scope.go:117] "RemoveContainer" containerID="8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"
Sep 15 20:15:14.278566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.278544    2554 scope.go:117] "RemoveContainer" containerID="8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"
Sep 15 20:15:14.278835 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:15:14.278815    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf\": container with ID starting with 8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf not found: ID does not exist" containerID="8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"
Sep 15 20:15:14.278879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.278845    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf"} err="failed to get container status \"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf\": rpc error: code = NotFound desc = could not find container \"8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf\": container with ID starting with 8594ab613ae5995678596ecdd54f44d0f016ba08dfa8a67e9fac61a4061c0adf not found: ID does not exist"
Sep 15 20:15:14.287935 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.287905    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:15:14.292498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:14.292472    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7974dfcc7b-jm4wf"]
Sep 15 20:15:16.022522 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:16.022492    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14cd0f9-d67e-4332-a774-b1bb31defe03" path="/var/lib/kubelet/pods/f14cd0f9-d67e-4332-a774-b1bb31defe03/volumes"
Sep 15 20:15:48.267478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.267438    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"]
Sep 15 20:15:48.267896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.267853    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14cd0f9-d67e-4332-a774-b1bb31defe03" containerName="console"
Sep 15 20:15:48.267896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.267871    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14cd0f9-d67e-4332-a774-b1bb31defe03" containerName="console"
Sep 15 20:15:48.269839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.268507    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14cd0f9-d67e-4332-a774-b1bb31defe03" containerName="console"
Sep 15 20:15:48.273138 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.272101    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.275319 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.275292    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-fwcqt\""
Sep 15 20:15:48.289102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.289074    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"]
Sep 15 20:15:48.374271 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374232    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2472ef40-b8de-4b50-bb63-1180f2faada5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374280    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r8m4\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-kube-api-access-6r8m4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374310    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374489    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374516    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374540    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.374564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.374557    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475074    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2472ef40-b8de-4b50-bb63-1180f2faada5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475115    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6r8m4\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-kube-api-access-6r8m4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475177    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475470 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475346    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475470 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475429    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475470 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475456    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475491    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475510    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475542    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475841 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475808    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475841 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475837    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475962 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475880    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2472ef40-b8de-4b50-bb63-1180f2faada5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.475962 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.475880    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.477675 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.477655    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.477898 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.477880    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.484442 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.484409    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.484586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.484502    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r8m4\" (UniqueName: \"kubernetes.io/projected/2472ef40-b8de-4b50-bb63-1180f2faada5-kube-api-access-6r8m4\") pod \"maas-default-gateway-openshift-default-5ccb968c66-7pcnw\" (UID: \"2472ef40-b8de-4b50-bb63-1180f2faada5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.583243 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.583153    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:48.861440 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:48.859352    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"]
Sep 15 20:15:48.863337 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:15:48.863308    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2472ef40_b8de_4b50_bb63_1180f2faada5.slice/crio-f5f7ada74e8ceb9e9804bef874b15153e3cc7a6af8acd2ab2fb1bafc33e1ed67 WatchSource:0}: Error finding container f5f7ada74e8ceb9e9804bef874b15153e3cc7a6af8acd2ab2fb1bafc33e1ed67: Status 404 returned error can't find the container with id f5f7ada74e8ceb9e9804bef874b15153e3cc7a6af8acd2ab2fb1bafc33e1ed67
Sep 15 20:15:49.404566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:49.404527    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" event={"ID":"2472ef40-b8de-4b50-bb63-1180f2faada5","Type":"ContainerStarted","Data":"f5f7ada74e8ceb9e9804bef874b15153e3cc7a6af8acd2ab2fb1bafc33e1ed67"}
Sep 15 20:15:51.921198 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:51.921157    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:15:51.921530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:51.921228    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:15:51.921530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:51.921256    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:15:52.418925 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:52.418891    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" event={"ID":"2472ef40-b8de-4b50-bb63-1180f2faada5","Type":"ContainerStarted","Data":"0fd6918844763f2d26e539c4e630230c1d03c6c079f56b6daf69c4d604acda94"}
Sep 15 20:15:52.442133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:52.442071    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podStartSLOduration=1.3874363029999999 podStartE2EDuration="4.442054065s" totalImagesPullingTime="3.054617762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:15:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:15:52.440274752 +0000 UTC m=+646.885233761" watchObservedRunningTime="2026-09-15 20:15:52.442054065 +0000 UTC m=+646.887013074"
Sep 15 20:15:52.584231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:52.584194    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:52.589068 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:52.589042    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:53.423813 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:53.423785    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:15:53.424824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:15:53.424802    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:16:02.042616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.042579    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:16:02.045815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.045791    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.048320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.048294    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 15 20:16:02.048468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.048323    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 15 20:16:02.049331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.049314    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 15 20:16:02.049376 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.049339    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zwnp4\""
Sep 15 20:16:02.054895 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.054865    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:16:02.091031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.090991    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:16:02.188591 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.188541    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-config-file\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.188768 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.188597    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzrkp\" (UniqueName: \"kubernetes.io/projected/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-kube-api-access-tzrkp\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.290066 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.289956    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-config-file\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.290308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.290090    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tzrkp\" (UniqueName: \"kubernetes.io/projected/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-kube-api-access-tzrkp\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.290653 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.290633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-config-file\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.299239 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.299170    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzrkp\" (UniqueName: \"kubernetes.io/projected/2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e-kube-api-access-tzrkp\") pod \"limitador-limitador-84994f7ffc-5nrrx\" (UID: \"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.357107 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.357066    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:02.635133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:02.635036    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:16:02.638005 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:16:02.637961    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6f6d02_e8f3_45b1_bd33_1f0662b9b78e.slice/crio-92a1e9206299e7cce44ceb9cf542c2d81f1f21993c62eb0dd6a0460fb88c8a2f WatchSource:0}: Error finding container 92a1e9206299e7cce44ceb9cf542c2d81f1f21993c62eb0dd6a0460fb88c8a2f: Status 404 returned error can't find the container with id 92a1e9206299e7cce44ceb9cf542c2d81f1f21993c62eb0dd6a0460fb88c8a2f
Sep 15 20:16:03.464328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:03.464286    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx" event={"ID":"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e","Type":"ContainerStarted","Data":"92a1e9206299e7cce44ceb9cf542c2d81f1f21993c62eb0dd6a0460fb88c8a2f"}
Sep 15 20:16:05.474320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:05.474287    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx" event={"ID":"2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e","Type":"ContainerStarted","Data":"5dc0f264b853e771cf8eb5ce7e9a13d1a6f1a417ad57a00ac0f485f839dd2111"}
Sep 15 20:16:05.474721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:05.474388    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:16:05.491255 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:05.491200    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx" podStartSLOduration=1.040139933 podStartE2EDuration="3.491181361s" totalImagesPullingTime="2.451041428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:16:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:16:05.490913449 +0000 UTC m=+659.935872458" watchObservedRunningTime="2026-09-15 20:16:05.491181361 +0000 UTC m=+659.936140368"
Sep 15 20:16:16.479911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:16:16.479876    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"
Sep 15 20:17:13.644700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:13.644624    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:17:23.425280 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.425237    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:23.425779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.425319    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:23.795602 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.795569    2554 generic.go:356] "Generic (PLEG): container finished" podID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerID="0fd6918844763f2d26e539c4e630230c1d03c6c079f56b6daf69c4d604acda94" exitCode=0
Sep 15 20:17:23.795766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.795623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" event={"ID":"2472ef40-b8de-4b50-bb63-1180f2faada5","Type":"ContainerDied","Data":"0fd6918844763f2d26e539c4e630230c1d03c6c079f56b6daf69c4d604acda94"}
Sep 15 20:17:23.796028 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.796013    2554 scope.go:117] "RemoveContainer" containerID="0fd6918844763f2d26e539c4e630230c1d03c6c079f56b6daf69c4d604acda94"
Sep 15 20:17:23.796953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.796924    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:17:23.797034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.797009    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:17:23.797072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:23.797044    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:17:24.802369 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:24.802336    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" event={"ID":"2472ef40-b8de-4b50-bb63-1180f2faada5","Type":"ContainerStarted","Data":"d9074ab8f1113aac1de90b446c67c083df1ca068ea050e13cb4e9a2e4f5b955b"}
Sep 15 20:17:25.584431 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:25.584388    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:17:25.584648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:25.584617    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:25.584725 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:25.584679    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:26.583584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:26.583544    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:26.584031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:26.583629    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:27.583933 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:27.583895    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:27.584358 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:27.583965    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:28.584305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:28.584268    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:28.584713 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:28.584333    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:29.583873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:29.583832    2554 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-7pcnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused" start-of-body=
Sep 15 20:17:29.584053 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:29.583892    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw" podUID="2472ef40-b8de-4b50-bb63-1180f2faada5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.22:15021/healthz/ready\": dial tcp 10.134.0.22:15021: connect: connection refused"
Sep 15 20:17:30.587882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:30.587849    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:17:30.588397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:30.588188    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:17:30.588710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:30.588689    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-7pcnw"
Sep 15 20:17:47.184495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:47.184456    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:17:58.933765 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:17:58.933730    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:18:04.736273 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.736230    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"]
Sep 15 20:18:04.739884 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.739859    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.743860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.743682    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 15 20:18:04.744417 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.744379    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-mtfkw\""
Sep 15 20:18:04.744737 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.744716    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 20:18:04.744830 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.744764    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 20:18:04.753100 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.753069    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"]
Sep 15 20:18:04.896300 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896267    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.896487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.896487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896356    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.896487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896436    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg8bb\" (UniqueName: \"kubernetes.io/projected/212d4d5d-27c0-40f4-9b60-50269d4529a0-kube-api-access-bg8bb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.896601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896495    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.896601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.896538    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212d4d5d-27c0-40f4-9b60-50269d4529a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.997797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997707    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.997797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997768    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.997797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997794    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997825    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg8bb\" (UniqueName: \"kubernetes.io/projected/212d4d5d-27c0-40f4-9b60-50269d4529a0-kube-api-access-bg8bb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997856    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.997887    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212d4d5d-27c0-40f4-9b60-50269d4529a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998304 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.998264    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998426 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.998275    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:04.998426 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:04.998333    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:05.000161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.000132    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/212d4d5d-27c0-40f4-9b60-50269d4529a0-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:05.000335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.000317    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/212d4d5d-27c0-40f4-9b60-50269d4529a0-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:05.006953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.006931    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg8bb\" (UniqueName: \"kubernetes.io/projected/212d4d5d-27c0-40f4-9b60-50269d4529a0-kube-api-access-bg8bb\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6\" (UID: \"212d4d5d-27c0-40f4-9b60-50269d4529a0\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:05.056123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.056078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:05.327799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.327721    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"]
Sep 15 20:18:05.330835 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:18:05.330805    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod212d4d5d_27c0_40f4_9b60_50269d4529a0.slice/crio-f465264f9f575bcf973ab9aa7e67f089930c75f69b501911f079ada4c6a0863e WatchSource:0}: Error finding container f465264f9f575bcf973ab9aa7e67f089930c75f69b501911f079ada4c6a0863e: Status 404 returned error can't find the container with id f465264f9f575bcf973ab9aa7e67f089930c75f69b501911f079ada4c6a0863e
Sep 15 20:18:05.332076 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.332059    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 20:18:05.732937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.732898    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:18:05.973684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:05.973647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6" event={"ID":"212d4d5d-27c0-40f4-9b60-50269d4529a0","Type":"ContainerStarted","Data":"f465264f9f575bcf973ab9aa7e67f089930c75f69b501911f079ada4c6a0863e"}
Sep 15 20:18:06.979292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:06.979258    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6" event={"ID":"212d4d5d-27c0-40f4-9b60-50269d4529a0","Type":"ContainerStarted","Data":"03dea9ad57797e28afb052e2ee615b8b258a9c9c60794988b2d9be5060e9fb80"}
Sep 15 20:18:06.999965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:06.999907    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6" podStartSLOduration=2.048849114 podStartE2EDuration="2.99989094s" totalImagesPullingTime="951.041826ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:18:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:18:06.997496122 +0000 UTC m=+781.442455122" watchObservedRunningTime="2026-09-15 20:18:06.99989094 +0000 UTC m=+781.444849944"
Sep 15 20:18:15.056732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:15.056685    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:15.057360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:15.056776    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:15.069064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:15.069036    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:16.030302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:16.030266    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6"
Sep 15 20:18:41.630106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:18:41.630016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:19:00.633081 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.633039    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"]
Sep 15 20:19:00.636516 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.636494    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.639559 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.639535    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 15 20:19:00.647636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.647607    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"]
Sep 15 20:19:00.760837 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.760772    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/868370d6-1807-4f43-9925-e33fedb0fded-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.761084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.760891    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqfsj\" (UniqueName: \"kubernetes.io/projected/868370d6-1807-4f43-9925-e33fedb0fded-kube-api-access-fqfsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.761084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.760955    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.761208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.761101    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.761208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.761129    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.761208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.761150    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862200 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862151    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862209    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862240    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862272    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862338    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/868370d6-1807-4f43-9925-e33fedb0fded-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862397    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqfsj\" (UniqueName: \"kubernetes.io/projected/868370d6-1807-4f43-9925-e33fedb0fded-kube-api-access-fqfsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862638    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862684    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.862781 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.862726    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.864670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.864644    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/868370d6-1807-4f43-9925-e33fedb0fded-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.864884 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.864864    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/868370d6-1807-4f43-9925-e33fedb0fded-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.871411 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.871385    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqfsj\" (UniqueName: \"kubernetes.io/projected/868370d6-1807-4f43-9925-e33fedb0fded-kube-api-access-fqfsj\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr\" (UID: \"868370d6-1807-4f43-9925-e33fedb0fded\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:00.946885 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:00.946786    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:01.220146 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:01.219956    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"]
Sep 15 20:19:01.227804 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:19:01.227776    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod868370d6_1807_4f43_9925_e33fedb0fded.slice/crio-c1be1d1f4b614d176700985028b48b8bbcbbaaf95c3e6268b2fe2ab4dbb698ee WatchSource:0}: Error finding container c1be1d1f4b614d176700985028b48b8bbcbbaaf95c3e6268b2fe2ab4dbb698ee: Status 404 returned error can't find the container with id c1be1d1f4b614d176700985028b48b8bbcbbaaf95c3e6268b2fe2ab4dbb698ee
Sep 15 20:19:02.202940 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:02.202905    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr" event={"ID":"868370d6-1807-4f43-9925-e33fedb0fded","Type":"ContainerStarted","Data":"1c17bc22dd28887fa0fbd3f843edd85cb26371c5da89e8e3bfee6cd0a9069ea5"}
Sep 15 20:19:02.203487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:02.202961    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr" event={"ID":"868370d6-1807-4f43-9925-e33fedb0fded","Type":"ContainerStarted","Data":"c1be1d1f4b614d176700985028b48b8bbcbbaaf95c3e6268b2fe2ab4dbb698ee"}
Sep 15 20:19:02.220009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:02.219943    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr" podStartSLOduration=2.026645447 podStartE2EDuration="2.219922656s" totalImagesPullingTime="193.277209ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:19:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:19:02.219157168 +0000 UTC m=+836.664116176" watchObservedRunningTime="2026-09-15 20:19:02.219922656 +0000 UTC m=+836.664881663"
Sep 15 20:19:02.437610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:02.437573    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:19:09.231091 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:09.231056    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:19:10.947814 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:10.947780    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:10.948436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:10.948417    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:10.961800 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:10.961774    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:11.252798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:11.252767    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr"
Sep 15 20:19:20.231679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:19:20.231643    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:21:20.329276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.329239    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:21:20.332861 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.332832    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.335558 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.335533    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-01ea3b-openshift-default-dockercfg-vh6kx\""
Sep 15 20:21:20.344317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.344292    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:21:20.395607 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.395569    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:21:20.399479 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.399452    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.402461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.402435    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-7e3543-openshift-default-dockercfg-r8ggj\""
Sep 15 20:21:20.411206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.411180    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:21:20.437606 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437571    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.437797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437610    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.437797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.437797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437691    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.437797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89n9s\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.437797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437776    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437809    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437831    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437867    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437895    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437930    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5vkd\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.437956    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438027    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.438078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438055    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438146    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.438393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.438393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.438216    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539000 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.538946    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539021    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539048    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539076    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539251    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5vkd\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539285    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539439 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539329    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539439 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539357    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539439 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539368    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539439 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539396    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539437    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539467    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539440    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539536    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539578    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539611    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.539636 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539633    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539671    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539698    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539722    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89n9s\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539933    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.540005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.539939    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.540386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.540046    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.540386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.540200    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.540386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.540363    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.540858 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.540827    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.542185 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.542152    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.542609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.542586    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.542728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.542705    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.542796 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.542730    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.554004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.553951    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.554152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.554128    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5vkd\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.557572 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.557541    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89n9s\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s\") pod \"e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") " pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.558086 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.558063    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token\") pod \"e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") " pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.644330 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.644252    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:20.712012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.711650    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:20.923469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.923384    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:21:20.926888 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:21:20.926860    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61a05a5_6848_4f40_bf31_02566aabe533.slice/crio-795a3410187b476f5bbcc21faa4221dd5398a2e2a765864193131998608cbc02 WatchSource:0}: Error finding container 795a3410187b476f5bbcc21faa4221dd5398a2e2a765864193131998608cbc02: Status 404 returned error can't find the container with id 795a3410187b476f5bbcc21faa4221dd5398a2e2a765864193131998608cbc02
Sep 15 20:21:20.929748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.929707    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:20.929823 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.929783    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:20.929823 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.929812    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:20.992579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.992495    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:21:20.996568 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:21:20.996544    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ba6cf1_3be4_40e8_b660_816837572f06.slice/crio-0df7f9fc988cd0e1b447a18716bd3fcc84f0a718c5775d398a1235c0eff2dcd7 WatchSource:0}: Error finding container 0df7f9fc988cd0e1b447a18716bd3fcc84f0a718c5775d398a1235c0eff2dcd7: Status 404 returned error can't find the container with id 0df7f9fc988cd0e1b447a18716bd3fcc84f0a718c5775d398a1235c0eff2dcd7
Sep 15 20:21:20.998881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.998848    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:20.998959 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.998913    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:20.998959 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:20.998945    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:21.798071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.798018    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerStarted","Data":"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"}
Sep 15 20:21:21.798512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.798092    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerStarted","Data":"0df7f9fc988cd0e1b447a18716bd3fcc84f0a718c5775d398a1235c0eff2dcd7"}
Sep 15 20:21:21.799579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.799551    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerStarted","Data":"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"}
Sep 15 20:21:21.799671 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.799601    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerStarted","Data":"795a3410187b476f5bbcc21faa4221dd5398a2e2a765864193131998608cbc02"}
Sep 15 20:21:21.819751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.819700    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podStartSLOduration=1.8196820420000002 podStartE2EDuration="1.819682042s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:21.818650052 +0000 UTC m=+976.263609085" watchObservedRunningTime="2026-09-15 20:21:21.819682042 +0000 UTC m=+976.264641050"
Sep 15 20:21:21.841838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:21.841777    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podStartSLOduration=1.841758851 podStartE2EDuration="1.841758851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:21.840664128 +0000 UTC m=+976.285623135" watchObservedRunningTime="2026-09-15 20:21:21.841758851 +0000 UTC m=+976.286717858"
Sep 15 20:21:22.644614 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.644575    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:22.649527 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.649496    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:22.712547 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.712508    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:22.718607 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.718581    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:22.805012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.804951    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:22.805407 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.805037    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:22.805935 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.805915    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:22.806103 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:22.806012    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:24.360713 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:24.360673    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:21:27.521111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.521075    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:21:27.524647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.524622    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.527423 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.527393    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-30d5aa-openshift-default-dockercfg-pqkns\""
Sep 15 20:21:27.539117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.539078    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:21:27.609442 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.609394    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.609761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.609735    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.609875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.609788    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.609941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.609863    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.610017 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.609959    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.610080 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.610035    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.610132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.610115    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.610184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.610153    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.610242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.610210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpbz4\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.710686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710646    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.710686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710688    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.710944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710719    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.710944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710845    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.710944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710904    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpbz4\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.710959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711033    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711075    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711103    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711138    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711199    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711255    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711542 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711517    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.711783 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.711763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.713296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.713269    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.713630 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.713604    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.719088 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.719055    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpbz4\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.719206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.719128    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token\") pod \"e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") " pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:27.836143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:27.836061    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:28.136402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.136292    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:21:28.144137 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.144102    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:28.144217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.144179    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:28.144255 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.144214    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:28.834930 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.834893    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerStarted","Data":"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"}
Sep 15 20:21:28.835370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.835000    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerStarted","Data":"0b539e6206d208965c4196f0bd782bb1f3cdfa90d8a53ee9a5cb42651e91b563"}
Sep 15 20:21:28.836241 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.836223    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:28.860179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:28.860126    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podStartSLOduration=1.8601100449999999 podStartE2EDuration="1.860110045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:28.8582605 +0000 UTC m=+983.303219508" watchObservedRunningTime="2026-09-15 20:21:28.860110045 +0000 UTC m=+983.305069054"
Sep 15 20:21:29.841255 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:29.841226    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:30.430952 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.430913    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:21:30.434883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.434855    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.438125 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.438095    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-5005f4d9-openshift-default-dockercfg-bp4xv\""
Sep 15 20:21:30.451502 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.451472    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:21:30.542940 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.542884    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.542952    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543011    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543029    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543056    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543082    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z52g\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543143    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.543445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.543193    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644167    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644187    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644219    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644253    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644283    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644299    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644466    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644507    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z52g\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644693    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644769    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.644920 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.644890    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.645069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.645025    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.645169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.645065    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.646758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.646694    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.646904 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.646882    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.653839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.653813    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.654105 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.654078    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z52g\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g\") pod \"e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") " pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.746811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.746774    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:30.844016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.843973    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:30.845056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:30.845033    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:21:31.036179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.036061    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:21:31.049757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.049211    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:31.049757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.049306    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:31.049757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.049348    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:31.857879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.857830    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerStarted","Data":"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"}
Sep 15 20:21:31.858400 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.857903    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerStarted","Data":"da81cae8717caa5bdb2583cc8dacdbcdacb27e78360935c2e15bd4a0ef1dd813"}
Sep 15 20:21:31.881744 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:31.881659    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" podStartSLOduration=1.881633013 podStartE2EDuration="1.881633013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:31.878693855 +0000 UTC m=+986.323652864" watchObservedRunningTime="2026-09-15 20:21:31.881633013 +0000 UTC m=+986.326592022"
Sep 15 20:21:32.747386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:32.747345    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:32.755166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:32.755131    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:32.865045 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:32.865009    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:32.869780 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:32.869742    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:21:36.846545 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:36.846506    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:21:37.864024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.863950    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:21:37.867788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.867757    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:37.871702 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.871668    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-5005f4d9\""
Sep 15 20:21:37.871864 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.871765    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-5005f4d9-dockercfg-qfr2l\""
Sep 15 20:21:37.882631 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.882596    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:21:37.893673 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.893377    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:21:37.896824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.896795    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:37.917601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:37.917564    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:21:38.043948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.043899    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.044210 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.044011    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6vm\" (UniqueName: \"kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.044210 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.044076    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.044210 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.044171    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kctrj\" (UniqueName: \"kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.145402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.145295    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6vm\" (UniqueName: \"kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.145585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.145403    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.145585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.145486    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kctrj\" (UniqueName: \"kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.145585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.145548    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.146254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.146227    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.146525 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.146502    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.154483 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.154452    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kctrj\" (UniqueName: \"kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj\") pod \"payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.154975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.154946    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6vm\" (UniqueName: \"kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm\") pod \"payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") " pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.182368 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.182336    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:38.211805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.211730    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:38.489570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.489526    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:21:38.492336 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:21:38.492304    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbb8fb8_6110_4c5b_8258_2852522325c9.slice/crio-9b77322f46b153ef6edbf9dd6ee17475e5567039c66d4035f21e3264604d359e WatchSource:0}: Error finding container 9b77322f46b153ef6edbf9dd6ee17475e5567039c66d4035f21e3264604d359e: Status 404 returned error can't find the container with id 9b77322f46b153ef6edbf9dd6ee17475e5567039c66d4035f21e3264604d359e
Sep 15 20:21:38.544774 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.544737    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:21:38.547234 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:21:38.547199    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa6e8a8f_0089_44da_af93_f1b3320b87b1.slice/crio-acfb4c4610bda20b4b091e828907880ccb048b2a9a4dbdc14fb0dc00ec70a0f7 WatchSource:0}: Error finding container acfb4c4610bda20b4b091e828907880ccb048b2a9a4dbdc14fb0dc00ec70a0f7: Status 404 returned error can't find the container with id acfb4c4610bda20b4b091e828907880ccb048b2a9a4dbdc14fb0dc00ec70a0f7
Sep 15 20:21:38.846276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.846173    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 20:21:38.846460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.846264    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 20:21:38.846460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.846189    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 20:21:38.846460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.846402    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 20:21:38.905846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.905808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" event={"ID":"aa6e8a8f-0089-44da-af93-f1b3320b87b1","Type":"ContainerStarted","Data":"acfb4c4610bda20b4b091e828907880ccb048b2a9a4dbdc14fb0dc00ec70a0f7"}
Sep 15 20:21:38.907302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:38.907268    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" event={"ID":"bbbb8fb8-6110-4c5b-8258-2852522325c9","Type":"ContainerStarted","Data":"9b77322f46b153ef6edbf9dd6ee17475e5567039c66d4035f21e3264604d359e"}
Sep 15 20:21:40.920531 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.920431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" event={"ID":"aa6e8a8f-0089-44da-af93-f1b3320b87b1","Type":"ContainerStarted","Data":"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"}
Sep 15 20:21:40.920531 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.920502    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:40.922187 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.922161    2554 generic.go:356] "Generic (PLEG): container finished" podID="e61a05a5-6848-4f40-bf31-02566aabe533" containerID="005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf" exitCode=0
Sep 15 20:21:40.922311 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.922231    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerDied","Data":"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"}
Sep 15 20:21:40.922672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.922641    2554 scope.go:117] "RemoveContainer" containerID="005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"
Sep 15 20:21:40.923975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.923942    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.924082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.924046    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.924147 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.924092    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.924206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.924133    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" event={"ID":"bbbb8fb8-6110-4c5b-8258-2852522325c9","Type":"ContainerStarted","Data":"d542cd03999ec420c478ffe356136afc87544f9a0fdb5567ffb13fbe4a884b89"}
Sep 15 20:21:40.924259 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.924207    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:40.926088 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.926067    2554 generic.go:356] "Generic (PLEG): container finished" podID="79ba6cf1-3be4-40e8-b660-816837572f06" containerID="0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d" exitCode=0
Sep 15 20:21:40.926169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.926110    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerDied","Data":"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"}
Sep 15 20:21:40.926520 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.926503    2554 scope.go:117] "RemoveContainer" containerID="0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"
Sep 15 20:21:40.927712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.927680    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.927790 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.927772    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.927844 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.927828    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:40.938464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.938415    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" podStartSLOduration=1.998224028 podStartE2EDuration="3.938389687s" totalImagesPullingTime="1.940165659s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:40.938258689 +0000 UTC m=+995.383217699" watchObservedRunningTime="2026-09-15 20:21:40.938389687 +0000 UTC m=+995.383348695"
Sep 15 20:21:40.959341 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:40.959275    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" podStartSLOduration=2.386366484 podStartE2EDuration="3.959250666s" totalImagesPullingTime="1.572884182s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:40.95625263 +0000 UTC m=+995.401211638" watchObservedRunningTime="2026-09-15 20:21:40.959250666 +0000 UTC m=+995.404209676"
Sep 15 20:21:41.950719 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:41.950668    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerStarted","Data":"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"}
Sep 15 20:21:41.957642 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:41.957596    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerStarted","Data":"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"}
Sep 15 20:21:42.644958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.644917    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:42.645872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.645693    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:21:42.646085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.646058    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:21:42.713123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.713092    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:42.713975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.713950    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 15 20:21:42.714225 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:42.714193    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 15 20:21:43.644960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:43.644906    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:21:43.645485 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:43.645007    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:21:43.712816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:43.712779    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 15 20:21:43.713012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:43.712839    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 15 20:21:44.403832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.403797    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:21:44.410162 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.410134    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.413108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.412877    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-39c7b0-openshift-default-dockercfg-258r8\""
Sep 15 20:21:44.421548 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.421507    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:21:44.507860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.507828    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508041 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.507864    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508041 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.507911    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508041 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.507929    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.508054    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.508102    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hknlg\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.508170    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.508186    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.508269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.508211    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609568    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609625    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609645    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609703    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609741    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.609805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609775    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hknlg\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.610171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609811    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.610171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.609827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.610566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.610545    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.611111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.610545    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.611234 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.611008    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.611305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.611068    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.611399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.611378    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.612424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.612403    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.613383 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.613351    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.618691 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.618670    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.619168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.619153    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hknlg\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg\") pod \"e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") " pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:44.645379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.645333    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:21:44.645872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.645404    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:21:44.712515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.712481    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 15 20:21:44.712698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.712547    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 15 20:21:44.723298 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:44.723223    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:45.125964 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.125930    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:21:45.130132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.130101    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:45.130206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.130167    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:45.130206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.130194    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:21:45.645768 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.645718    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:21:45.646299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.645805    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:21:45.712654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.712614    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 15 20:21:45.712822 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.712689    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 15 20:21:45.993221 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.993184    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerStarted","Data":"850d345ca1a4386388e479609d95057e16f5740ab676ca9d28db61fbc1512c89"}
Sep 15 20:21:45.993411 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:45.993274    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerStarted","Data":"7f82f96da9413f20274ca5c4ff6bd129333cc5ec0746b1ae575b04ae12dc9a8c"}
Sep 15 20:21:46.018947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.018868    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podStartSLOduration=2.018845465 podStartE2EDuration="2.018845465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:46.018238994 +0000 UTC m=+1000.463197992" watchObservedRunningTime="2026-09-15 20:21:46.018845465 +0000 UTC m=+1000.463804476"
Sep 15 20:21:46.645690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.645649    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:21:46.646012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.645956    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:21:46.713379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.713336    2554 patch_prober.go:28] interesting pod/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused" start-of-body=
Sep 15 20:21:46.713586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.713405    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.27:15021/healthz/ready\": dial tcp 10.134.0.27:15021: connect: connection refused"
Sep 15 20:21:46.723482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.723445    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:46.728719 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.728692    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:46.997926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.997895    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:46.999049 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:46.999030    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:21:47.649176 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.649130    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:47.649668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.649526    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:47.650262 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.650240    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:21:47.717383 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.717298    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:47.717947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.717839    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:47.719134 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:47.719109    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:21:51.961236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:51.961197    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:21:51.961812 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:51.961629    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:21:53.683784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.683748    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"]
Sep 15 20:21:53.688710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.688689    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:21:53.691948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.691923    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:21:53.692152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.692138    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:21:53.697140 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.697120    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"]
Sep 15 20:21:53.802753 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.802712    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd\" (UID: \"3881efde-4bf1-4481-a80d-ff442055d564\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:21:53.904354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.904312    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd\" (UID: \"3881efde-4bf1-4481-a80d-ff442055d564\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:21:53.905029 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:53.905007    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd\" (UID: \"3881efde-4bf1-4481-a80d-ff442055d564\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:21:54.001042 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:54.000904    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:21:54.317089 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:54.317058    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"]
Sep 15 20:21:54.319291 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:21:54.319262    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3881efde_4bf1_4481_a80d_ff442055d564.slice/crio-73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff WatchSource:0}: Error finding container 73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff: Status 404 returned error can't find the container with id 73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff
Sep 15 20:21:55.041900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:55.041808    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd" event={"ID":"3881efde-4bf1-4481-a80d-ff442055d564","Type":"ContainerStarted","Data":"73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff"}
Sep 15 20:21:58.073846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:58.073803    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd" event={"ID":"3881efde-4bf1-4481-a80d-ff442055d564","Type":"ContainerStarted","Data":"b4865f43b68c2da04a292f4167baa069bdf36a36f364e8e0eceb2992ba0d1089"}
Sep 15 20:21:58.089430 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:58.089365    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd" podStartSLOduration=1.875933005 podStartE2EDuration="5.089343829s" totalImagesPullingTime="3.213410824s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:21:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:21:58.088350259 +0000 UTC m=+1012.533309268" watchObservedRunningTime="2026-09-15 20:21:58.089343829 +0000 UTC m=+1012.534302837"
Sep 15 20:21:59.081079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:59.081041    2554 generic.go:356] "Generic (PLEG): container finished" podID="3881efde-4bf1-4481-a80d-ff442055d564" containerID="b4865f43b68c2da04a292f4167baa069bdf36a36f364e8e0eceb2992ba0d1089" exitCode=0
Sep 15 20:21:59.081556 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:21:59.081111    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd" event={"ID":"3881efde-4bf1-4481-a80d-ff442055d564","Type":"ContainerDied","Data":"b4865f43b68c2da04a292f4167baa069bdf36a36f364e8e0eceb2992ba0d1089"}
Sep 15 20:22:00.087749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.087718    2554 generic.go:356] "Generic (PLEG): container finished" podID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerID="323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851" exitCode=0
Sep 15 20:22:00.088239 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.087801    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerDied","Data":"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"}
Sep 15 20:22:00.088517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.088248    2554 scope.go:117] "RemoveContainer" containerID="323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"
Sep 15 20:22:00.089591 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.089552    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:00.089695 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.089651    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:00.089738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.089696    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:00.256927 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.256903    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:22:00.396100 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.395967    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca\") pod \"3881efde-4bf1-4481-a80d-ff442055d564\" (UID: \"3881efde-4bf1-4481-a80d-ff442055d564\") "
Sep 15 20:22:00.396351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.396326    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3881efde-4bf1-4481-a80d-ff442055d564" (UID: "3881efde-4bf1-4481-a80d-ff442055d564"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:00.497375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.497332    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3881efde-4bf1-4481-a80d-ff442055d564-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:00.846150 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.846111    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:00.846355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:00.846176    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:01.038537 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.038489    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:22:01.094419 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.094390    2554 generic.go:356] "Generic (PLEG): container finished" podID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerID="ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81" exitCode=0
Sep 15 20:22:01.094908 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.094463    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerDied","Data":"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"}
Sep 15 20:22:01.095147 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.095127    2554 scope.go:117] "RemoveContainer" containerID="ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"
Sep 15 20:22:01.096064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.095851    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"
Sep 15 20:22:01.096064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.095851    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd" event={"ID":"3881efde-4bf1-4481-a80d-ff442055d564","Type":"ContainerDied","Data":"73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff"}
Sep 15 20:22:01.096064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.095956    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="73732c6c3da625530a8f99085416b21454558571189c2bf56e76d7dc821e61ff"
Sep 15 20:22:01.096587 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.096512    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:01.096670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.096617    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:01.096733 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.096668    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:01.097975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.097947    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerStarted","Data":"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"}
Sep 15 20:22:01.749818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.749297    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:22:01.749818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.749480    2554 patch_prober.go:28] interesting pod/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 15 20:22:01.749818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:01.749524    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 15 20:22:02.105032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.104924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerStarted","Data":"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"}
Sep 15 20:22:02.747719 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.747678    2554 patch_prober.go:28] interesting pod/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 15 20:22:02.748058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.748028    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 15 20:22:02.837527 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.837147    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:22:02.837952 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.837930    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:02.838143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.838119    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:02.866015 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:02.865936    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:22:03.748681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:03.748201    2554 patch_prober.go:28] interesting pod/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused" start-of-body=
Sep 15 20:22:03.748681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:03.748285    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.29:15021/healthz/ready\": dial tcp 10.134.0.29:15021: connect: connection refused"
Sep 15 20:22:03.836690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:03.836639    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:03.836869 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:03.836728    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:04.264329 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.264287    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:22:04.265252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.265204    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" podUID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" containerName="payload-processing" containerID="cri-o://be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93" gracePeriod=30
Sep 15 20:22:04.274017 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.273344    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:22:04.274017 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.273601    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" podUID="bbbb8fb8-6110-4c5b-8258-2852522325c9" containerName="payload-pre-processing" containerID="cri-o://d542cd03999ec420c478ffe356136afc87544f9a0fdb5567ffb13fbe4a884b89" gracePeriod=30
Sep 15 20:22:04.431747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.431531    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"]
Sep 15 20:22:04.440620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.440575    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-5005f4d9-mmzsd"]
Sep 15 20:22:04.577416 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.577317    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:22:04.577935 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.577891    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy" containerID="cri-o://20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147" gracePeriod=30
Sep 15 20:22:04.837370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.837267    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:04.837370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:04.837340    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:05.124841 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.124756    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:22:05.135009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.131659    2554 generic.go:356] "Generic (PLEG): container finished" podID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" containerID="be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93" exitCode=0
Sep 15 20:22:05.135009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.131829    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" event={"ID":"aa6e8a8f-0089-44da-af93-f1b3320b87b1","Type":"ContainerDied","Data":"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"}
Sep 15 20:22:05.135009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.131907    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm" event={"ID":"aa6e8a8f-0089-44da-af93-f1b3320b87b1","Type":"ContainerDied","Data":"acfb4c4610bda20b4b091e828907880ccb048b2a9a4dbdc14fb0dc00ec70a0f7"}
Sep 15 20:22:05.135009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.131959    2554 scope.go:117] "RemoveContainer" containerID="be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"
Sep 15 20:22:05.135009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.132272    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"
Sep 15 20:22:05.143005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.141487    2554 generic.go:356] "Generic (PLEG): container finished" podID="bbbb8fb8-6110-4c5b-8258-2852522325c9" containerID="d542cd03999ec420c478ffe356136afc87544f9a0fdb5567ffb13fbe4a884b89" exitCode=0
Sep 15 20:22:05.143005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.141621    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" event={"ID":"bbbb8fb8-6110-4c5b-8258-2852522325c9","Type":"ContainerDied","Data":"d542cd03999ec420c478ffe356136afc87544f9a0fdb5567ffb13fbe4a884b89"}
Sep 15 20:22:05.167005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.166347    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk6vm\" (UniqueName: \"kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm\") pod \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") "
Sep 15 20:22:05.167005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.166465    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume\") pod \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\" (UID: \"aa6e8a8f-0089-44da-af93-f1b3320b87b1\") "
Sep 15 20:22:05.167244 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.167098    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "aa6e8a8f-0089-44da-af93-f1b3320b87b1" (UID: "aa6e8a8f-0089-44da-af93-f1b3320b87b1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:05.180023 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.176493    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm" (OuterVolumeSpecName: "kube-api-access-wk6vm") pod "aa6e8a8f-0089-44da-af93-f1b3320b87b1" (UID: "aa6e8a8f-0089-44da-af93-f1b3320b87b1"). InnerVolumeSpecName "kube-api-access-wk6vm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:05.220013 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.217688    2554 scope.go:117] "RemoveContainer" containerID="be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"
Sep 15 20:22:05.220013 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:05.218248    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93\": container with ID starting with be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93 not found: ID does not exist" containerID="be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"
Sep 15 20:22:05.220013 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.218293    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93"} err="failed to get container status \"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93\": rpc error: code = NotFound desc = could not find container \"be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93\": container with ID starting with be691155be823613ecfb94d6643f99b3bbb386b1129e168fff2a4c8a7acd4d93 not found: ID does not exist"
Sep 15 20:22:05.275588 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.275549    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk6vm\" (UniqueName: \"kubernetes.io/projected/aa6e8a8f-0089-44da-af93-f1b3320b87b1-kube-api-access-wk6vm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:05.276283 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.276261    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/aa6e8a8f-0089-44da-af93-f1b3320b87b1-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:05.315553 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.315520    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:22:05.393081 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.392317    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume\") pod \"bbbb8fb8-6110-4c5b-8258-2852522325c9\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") "
Sep 15 20:22:05.393081 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.392452    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kctrj\" (UniqueName: \"kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj\") pod \"bbbb8fb8-6110-4c5b-8258-2852522325c9\" (UID: \"bbbb8fb8-6110-4c5b-8258-2852522325c9\") "
Sep 15 20:22:05.397005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.393460    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bbbb8fb8-6110-4c5b-8258-2852522325c9" (UID: "bbbb8fb8-6110-4c5b-8258-2852522325c9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:05.399476 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.399423    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj" (OuterVolumeSpecName: "kube-api-access-kctrj") pod "bbbb8fb8-6110-4c5b-8258-2852522325c9" (UID: "bbbb8fb8-6110-4c5b-8258-2852522325c9"). InnerVolumeSpecName "kube-api-access-kctrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:05.490447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.490408    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:22:05.496951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.496913    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-5005f4d9-65b4b9b4df-h4lvm"]
Sep 15 20:22:05.503004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.498628    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kctrj\" (UniqueName: \"kubernetes.io/projected/bbbb8fb8-6110-4c5b-8258-2852522325c9-kube-api-access-kctrj\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:05.503004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.498668    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bbbb8fb8-6110-4c5b-8258-2852522325c9-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615210    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615776    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbbb8fb8-6110-4c5b-8258-2852522325c9" containerName="payload-pre-processing"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615797    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbbb8fb8-6110-4c5b-8258-2852522325c9" containerName="payload-pre-processing"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615813    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3881efde-4bf1-4481-a80d-ff442055d564" containerName="revoke-keys"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615822    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3881efde-4bf1-4481-a80d-ff442055d564" containerName="revoke-keys"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615833    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" containerName="payload-processing"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615843    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" containerName="payload-processing"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615944    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" containerName="payload-processing"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615960    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3881efde-4bf1-4481-a80d-ff442055d564" containerName="revoke-keys"
Sep 15 20:22:05.616007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.615972    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbbb8fb8-6110-4c5b-8258-2852522325c9" containerName="payload-pre-processing"
Sep 15 20:22:05.623699 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.623609    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.626793 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.626756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e0b5e00e-gw-openshift-default-dockercfg-6mvzv\""
Sep 15 20:22:05.630537 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.630501    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:05.703556 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.703459    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.703784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.703765    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.703951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.703933    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704099    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704247 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704232    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704330    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704449    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704574 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704560    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.704718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.704703    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjxzb\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.805875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.805819    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.805890    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.805937    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.805962    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.806020    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.806049    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.806113    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjxzb\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806457 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.806195    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.806457 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.806221    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.807067 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.807036    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.807402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.807375    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.807650 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.807625    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.809735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.808448    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.809735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.809107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.826738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.826689    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.830110 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.830068    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.830699 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.830653    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjxzb\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.830955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.830924    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy\") pod \"e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") " pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:05.839008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.836714    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:05.839008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.836791    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:05.957115 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.957082    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-e0b5e00e-gw-openshift-default-dockercfg-6mvzv\""
Sep 15 20:22:05.962756 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:05.962450    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:06.025573 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.025442    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3881efde-4bf1-4481-a80d-ff442055d564" path="/var/lib/kubelet/pods/3881efde-4bf1-4481-a80d-ff442055d564/volumes"
Sep 15 20:22:06.025836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.025820    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa6e8a8f-0089-44da-af93-f1b3320b87b1" path="/var/lib/kubelet/pods/aa6e8a8f-0089-44da-af93-f1b3320b87b1/volumes"
Sep 15 20:22:06.159006 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.158612    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq" event={"ID":"bbbb8fb8-6110-4c5b-8258-2852522325c9","Type":"ContainerDied","Data":"9b77322f46b153ef6edbf9dd6ee17475e5567039c66d4035f21e3264604d359e"}
Sep 15 20:22:06.159006 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.158688    2554 scope.go:117] "RemoveContainer" containerID="d542cd03999ec420c478ffe356136afc87544f9a0fdb5567ffb13fbe4a884b89"
Sep 15 20:22:06.159006 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.158868    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"
Sep 15 20:22:06.224449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.224385    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:22:06.227050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.227015    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-5005f4d9-584b5798c8-6bxbq"]
Sep 15 20:22:06.386408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.386363    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:06.405331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.404680    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:06.405331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.404779    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:06.405331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.404825    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:06.837698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.837109    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused" start-of-body=
Sep 15 20:22:06.837698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:06.837198    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.28:15021/healthz/ready\": dial tcp 10.134.0.28:15021: connect: connection refused"
Sep 15 20:22:07.169023 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.168908    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerStarted","Data":"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"}
Sep 15 20:22:07.169627 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.169595    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerStarted","Data":"bcd64c9a2cb85def23d68c40a125366f6d7a8af3c505d5b4fbd847c7382415ae"}
Sep 15 20:22:07.196340 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.196272    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podStartSLOduration=2.196233359 podStartE2EDuration="2.196233359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:07.192769949 +0000 UTC m=+1021.637728959" watchObservedRunningTime="2026-09-15 20:22:07.196233359 +0000 UTC m=+1021.641192368"
Sep 15 20:22:07.849637 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.849599    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:22:07.851639 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.851601    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:22:07.858580 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.858532    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:22:07.962752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.962709    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:07.968600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:07.968564    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:08.024751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:08.024716    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bbbb8fb8-6110-4c5b-8258-2852522325c9" path="/var/lib/kubelet/pods/bbbb8fb8-6110-4c5b-8258-2852522325c9/volumes"
Sep 15 20:22:08.174894 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:08.174800    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:08.176009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:08.175974    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:10.917434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:10.917390    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:10.924224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:10.924193    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:10.927414 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:10.927386    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-e0b5e00e-dockercfg-pdw7g\""
Sep 15 20:22:10.927414 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:10.927403    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-e0b5e00e\""
Sep 15 20:22:10.947789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:10.947755    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:11.098409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.098367    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.100609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.098417    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87mfc\" (UniqueName: \"kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.192177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.192089    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerID="850d345ca1a4386388e479609d95057e16f5740ab676ca9d28db61fbc1512c89" exitCode=0
Sep 15 20:22:11.192177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.192139    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerDied","Data":"850d345ca1a4386388e479609d95057e16f5740ab676ca9d28db61fbc1512c89"}
Sep 15 20:22:11.192575 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.192560    2554 scope.go:117] "RemoveContainer" containerID="850d345ca1a4386388e479609d95057e16f5740ab676ca9d28db61fbc1512c89"
Sep 15 20:22:11.193693 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.193652    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:11.193755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.193741    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:11.193792 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.193777    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:11.199744 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.199724    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.199810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.199755    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87mfc\" (UniqueName: \"kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.200395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.200373    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.208792 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.208768    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87mfc\" (UniqueName: \"kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc\") pod \"payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.235910 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.235880    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:11.521147 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:11.521051    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:11.523889 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:11.523850    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca82b63a_e6c2_4abe_a5d3_d72bc40d48ab.slice/crio-d1b4ee68fb2472b31e202756dca5192b6d9523a8f073f6a3a414f0ae2f67d98d WatchSource:0}: Error finding container d1b4ee68fb2472b31e202756dca5192b6d9523a8f073f6a3a414f0ae2f67d98d: Status 404 returned error can't find the container with id d1b4ee68fb2472b31e202756dca5192b6d9523a8f073f6a3a414f0ae2f67d98d
Sep 15 20:22:12.200161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.200124    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerStarted","Data":"6b2afc517fee4f66c8f02ffff4e37ae96e3f8d21428c01265bad26ca49cca7f2"}
Sep 15 20:22:12.201695 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.201664    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" event={"ID":"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab","Type":"ContainerStarted","Data":"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"}
Sep 15 20:22:12.201812 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.201716    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" event={"ID":"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab","Type":"ContainerStarted","Data":"d1b4ee68fb2472b31e202756dca5192b6d9523a8f073f6a3a414f0ae2f67d98d"}
Sep 15 20:22:12.201812 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.201782    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:12.238046 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.237959    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" podStartSLOduration=2.237939109 podStartE2EDuration="2.237939109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:12.237464788 +0000 UTC m=+1026.682423797" watchObservedRunningTime="2026-09-15 20:22:12.237939109 +0000 UTC m=+1026.682898119"
Sep 15 20:22:12.460161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.460135    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613731    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613787    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613827    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2z52g\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613879    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613930    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.613958    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.614036    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.614062    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.614091    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket\") pod \"d5c5c8cc-258a-43a3-9143-d07d66feff62\" (UID: \"d5c5c8cc-258a-43a3-9143-d07d66feff62\") "
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.614647    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:12.615014 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.614947    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:12.616113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.616034    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:12.618307 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.618235    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data" (OuterVolumeSpecName: "istio-data") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:12.618881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.618811    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:12.618999 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.618958    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g" (OuterVolumeSpecName: "kube-api-access-2z52g") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "kube-api-access-2z52g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:12.624064 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.624005    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:22:12.624242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.624030    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:12.624370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.624339    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token" (OuterVolumeSpecName: "istio-token") pod "d5c5c8cc-258a-43a3-9143-d07d66feff62" (UID: "d5c5c8cc-258a-43a3-9143-d07d66feff62"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714825    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714853    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714863    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714873    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c5c8cc-258a-43a3-9143-d07d66feff62-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714881    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714889    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2z52g\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-kube-api-access-2z52g\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714898    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714909    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.714915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.714916    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c5c8cc-258a-43a3-9143-d07d66feff62-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:12.723757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.723723    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:22:12.724762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.724741    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:12.724862 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:12.724786    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:13.209545 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.209510    2554 generic.go:356] "Generic (PLEG): container finished" podID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerID="20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147" exitCode=0
Sep 15 20:22:13.209937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.209566    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"
Sep 15 20:22:13.209937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.209585    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerDied","Data":"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"}
Sep 15 20:22:13.209937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.209665    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs" event={"ID":"d5c5c8cc-258a-43a3-9143-d07d66feff62","Type":"ContainerDied","Data":"da81cae8717caa5bdb2583cc8dacdbcdacb27e78360935c2e15bd4a0ef1dd813"}
Sep 15 20:22:13.209937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.209688    2554 scope.go:117] "RemoveContainer" containerID="20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"
Sep 15 20:22:13.219451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.219434    2554 scope.go:117] "RemoveContainer" containerID="323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"
Sep 15 20:22:13.227463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.227445    2554 scope.go:117] "RemoveContainer" containerID="20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"
Sep 15 20:22:13.227774 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:13.227755    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147\": container with ID starting with 20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147 not found: ID does not exist" containerID="20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"
Sep 15 20:22:13.227821 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.227785    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147"} err="failed to get container status \"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147\": rpc error: code = NotFound desc = could not find container \"20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147\": container with ID starting with 20c8f1a44f5a4366fddd12f8dd68698819e60eadd0314463f70f9b4c30338147 not found: ID does not exist"
Sep 15 20:22:13.227821 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.227802    2554 scope.go:117] "RemoveContainer" containerID="323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"
Sep 15 20:22:13.228103 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:13.228081    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851\": container with ID starting with 323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851 not found: ID does not exist" containerID="323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"
Sep 15 20:22:13.228150 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.228111    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851"} err="failed to get container status \"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851\": rpc error: code = NotFound desc = could not find container \"323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851\": container with ID starting with 323ed0c6f4fe138e089bbef657a441ce95f5e03ca0bcb441f59fda22c9386851 not found: ID does not exist"
Sep 15 20:22:13.235947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.235912    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:22:13.246670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.246622    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-5005f4d9-openshift-default-7dd64f55c4-hm2xs"]
Sep 15 20:22:13.723894 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.723853    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:13.724119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:13.723920    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:14.024375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:14.024276    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" path="/var/lib/kubelet/pods/d5c5c8cc-258a-43a3-9143-d07d66feff62/volumes"
Sep 15 20:22:14.724359 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:14.724320    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:14.724758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:14.724381    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:15.723912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:15.723871    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:15.724134 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:15.723930    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:16.724451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:16.724411    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:16.724868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:16.724472    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:16.998206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:16.998116    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:22:17.724222 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:17.724189    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body=
Sep 15 20:22:17.724415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:17.724251    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused"
Sep 15 20:22:18.727754 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:18.727721    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:22:18.728770 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:18.728750    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:22:20.937330 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:20.937289    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:22:23.211401 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:23.211362    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:31.306113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.306075    2554 generic.go:356] "Generic (PLEG): container finished" podID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerID="c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2" exitCode=0
Sep 15 20:22:31.306543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.306148    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerDied","Data":"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"}
Sep 15 20:22:31.306635 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.306617    2554 scope.go:117] "RemoveContainer" containerID="c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"
Sep 15 20:22:31.307753 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.307722    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:31.307816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.307794    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:31.307851 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:31.307826    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:32.313970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:32.313935    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerStarted","Data":"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"}
Sep 15 20:22:32.963602 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:32.963555    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:32.963787 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:32.963765    2554 patch_prober.go:28] interesting pod/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 15 20:22:32.963839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:32.963818    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 15 20:22:33.670212 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.670180    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"]
Sep 15 20:22:33.670934 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.670917    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.671052 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.671034    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.671119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.671080    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.671119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.671090    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.671214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.671197    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.671269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.671214    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d5c5c8cc-258a-43a3-9143-d07d66feff62" containerName="istio-proxy"
Sep 15 20:22:33.674142 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.674122    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:33.676743 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.676721    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:22:33.676890 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.676726    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:22:33.683098 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.683065    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"]
Sep 15 20:22:33.704240 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.704205    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm\" (UID: \"5ca10370-e28e-415a-8541-28baf609f9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:33.805529 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.805490    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm\" (UID: \"5ca10370-e28e-415a-8541-28baf609f9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:33.806184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.806163    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm\" (UID: \"5ca10370-e28e-415a-8541-28baf609f9f2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:33.963569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.963530    2554 patch_prober.go:28] interesting pod/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 15 20:22:33.963738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.963609    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 15 20:22:33.986363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:33.986332    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:34.280053 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:34.279958    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"]
Sep 15 20:22:34.283319 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:34.283280    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ca10370_e28e_415a_8541_28baf609f9f2.slice/crio-5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2 WatchSource:0}: Error finding container 5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2: Status 404 returned error can't find the container with id 5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2
Sep 15 20:22:34.328901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:34.328858    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm" event={"ID":"5ca10370-e28e-415a-8541-28baf609f9f2","Type":"ContainerStarted","Data":"5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2"}
Sep 15 20:22:34.963801 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:34.963762    2554 patch_prober.go:28] interesting pod/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 15 20:22:34.964254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:34.963818    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 15 20:22:35.336459 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:35.336415    2554 generic.go:356] "Generic (PLEG): container finished" podID="5ca10370-e28e-415a-8541-28baf609f9f2" containerID="a3547845d2ec32d6c054960a5b74b63df915eab97e260c3e7641d300d3d0fca1" exitCode=0
Sep 15 20:22:35.336667 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:35.336583    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm" event={"ID":"5ca10370-e28e-415a-8541-28baf609f9f2","Type":"ContainerDied","Data":"a3547845d2ec32d6c054960a5b74b63df915eab97e260c3e7641d300d3d0fca1"}
Sep 15 20:22:35.963158 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:35.963112    2554 patch_prober.go:28] interesting pod/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 15 20:22:35.963349 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:35.963215    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 15 20:22:36.517305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.517280    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:36.631190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.631103    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca\") pod \"5ca10370-e28e-415a-8541-28baf609f9f2\" (UID: \"5ca10370-e28e-415a-8541-28baf609f9f2\") "
Sep 15 20:22:36.631451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.631424    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5ca10370-e28e-415a-8541-28baf609f9f2" (UID: "5ca10370-e28e-415a-8541-28baf609f9f2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:36.732154 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.732106    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ca10370-e28e-415a-8541-28baf609f9f2-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:36.963265 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.963228    2554 patch_prober.go:28] interesting pod/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 15 20:22:36.963413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:36.963287    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 15 20:22:37.351363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.351275    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"
Sep 15 20:22:37.351363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.351287    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm" event={"ID":"5ca10370-e28e-415a-8541-28baf609f9f2","Type":"ContainerDied","Data":"5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2"}
Sep 15 20:22:37.351363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.351335    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5437032208a2585f2c9bcd2b22c0de77bc205fb4154f278ef22c5c9ca04e45f2"
Sep 15 20:22:37.967287 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.967255    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:37.967650 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.967623    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:37.968261 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:37.968241    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:40.517208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.517175    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:40.517660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.517401    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" podUID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" containerName="payload-pre-processing" containerID="cri-o://798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e" gracePeriod=30
Sep 15 20:22:40.690013 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.689970    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"]
Sep 15 20:22:40.696517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.696490    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-e0b5e00e-h8dcm"]
Sep 15 20:22:40.771924 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.771857    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:40.874155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.874119    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume\") pod \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") "
Sep 15 20:22:40.874299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.874202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-87mfc\" (UniqueName: \"kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc\") pod \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\" (UID: \"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab\") "
Sep 15 20:22:40.874500 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.874477    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" (UID: "ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:40.876407 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.876373    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc" (OuterVolumeSpecName: "kube-api-access-87mfc") pod "ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" (UID: "ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab"). InnerVolumeSpecName "kube-api-access-87mfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:40.889199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.889168    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:40.889395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.889369    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy" containerID="cri-o://22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f" gracePeriod=30
Sep 15 20:22:40.975357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.975313    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87mfc\" (UniqueName: \"kubernetes.io/projected/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-kube-api-access-87mfc\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:40.975357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:40.975357    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:41.371729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.371694    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" containerID="798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e" exitCode=0
Sep 15 20:22:41.371938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.371746    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"
Sep 15 20:22:41.371938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.371774    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" event={"ID":"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab","Type":"ContainerDied","Data":"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"}
Sep 15 20:22:41.371938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.371826    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l" event={"ID":"ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab","Type":"ContainerDied","Data":"d1b4ee68fb2472b31e202756dca5192b6d9523a8f073f6a3a414f0ae2f67d98d"}
Sep 15 20:22:41.371938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.371848    2554 scope.go:117] "RemoveContainer" containerID="798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"
Sep 15 20:22:41.385479 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.385458    2554 scope.go:117] "RemoveContainer" containerID="798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"
Sep 15 20:22:41.385817 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:41.385791    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e\": container with ID starting with 798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e not found: ID does not exist" containerID="798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"
Sep 15 20:22:41.385893 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.385830    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e"} err="failed to get container status \"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e\": rpc error: code = NotFound desc = could not find container \"798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e\": container with ID starting with 798df417a5f6cf9fc57e72806071e387110b554102bcafba7e34a12cd5c42e5e not found: ID does not exist"
Sep 15 20:22:41.399219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.399182    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:41.403266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.403238    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-e0b5e00e-979bc75cd-5nq6l"]
Sep 15 20:22:41.619227 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619194    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619567    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ca10370-e28e-415a-8541-28baf609f9f2" containerName="revoke-keys"
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619582    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ca10370-e28e-415a-8541-28baf609f9f2" containerName="revoke-keys"
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619603    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" containerName="payload-pre-processing"
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619610    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" containerName="payload-pre-processing"
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619666    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" containerName="payload-pre-processing"
Sep 15 20:22:41.619680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.619678    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ca10370-e28e-415a-8541-28baf609f9f2" containerName="revoke-keys"
Sep 15 20:22:41.624163 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.624109    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.627395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.627373    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9baa771e-openshift-default-dockercfg-nwkdv\""
Sep 15 20:22:41.635448 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.635419    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:22:41.681871 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.681823    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.681885    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.681975    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682032    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682077    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682118    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682181    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfqct\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682260    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.682318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.682307    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.719358 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.719314    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:22:41.723266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.723234    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.726532 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.726510    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"simulator-w4-725e67-kserve-self-signed-certs\""
Sep 15 20:22:41.727057 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.726739    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"default-dockercfg-bff2s\""
Sep 15 20:22:41.727534 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.726791    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"kube-root-ca.crt\""
Sep 15 20:22:41.727652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.726836    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"openshift-service-ca.crt\""
Sep 15 20:22:41.738080 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.738051    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:22:41.783771 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.783735    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.783895    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.783925    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784148 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784037    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784148 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784069    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784148 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784110    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784145    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784202    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784232    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784504 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784322    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784504 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784433    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784504 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784473    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784540    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfqct\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784586    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klhl4\" (UniqueName: \"kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.784652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784642    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784855 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784674    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.784928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.784901    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.785212 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.785187    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.786506 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.786482    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.787227 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.787206    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.796791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.796763    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfqct\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.797473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.797451    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token\") pod \"e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") " pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:41.885224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885166    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885199    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885231    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885248    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885313    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klhl4\" (UniqueName: \"kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885524    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885585    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.885665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.885639    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.887529 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.887502    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.887910 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.887886    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.906001 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.896772    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klhl4\" (UniqueName: \"kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4\") pod \"simulator-w4-725e67-kserve-f97f5bcf7-rvj9m\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") " pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:41.934152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:41.934112    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:42.025099 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.025070    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ca10370-e28e-415a-8541-28baf609f9f2" path="/var/lib/kubelet/pods/5ca10370-e28e-415a-8541-28baf609f9f2/volumes"
Sep 15 20:22:42.025445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.025431    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab" path="/var/lib/kubelet/pods/ca82b63a-e6c2-4abe-a5d3-d72bc40d48ab/volumes"
Sep 15 20:22:42.042238 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.042209    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:42.216661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.216630    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:22:42.219029 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:42.219000    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a486323_fb29_4c2f_ac1a_6bfd18b4fc04.slice/crio-4dfa1ed56fe909425bb584e10c77149e180c0b29b93b0179823ba1071a6ae928 WatchSource:0}: Error finding container 4dfa1ed56fe909425bb584e10c77149e180c0b29b93b0179823ba1071a6ae928: Status 404 returned error can't find the container with id 4dfa1ed56fe909425bb584e10c77149e180c0b29b93b0179823ba1071a6ae928
Sep 15 20:22:42.221357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.221321    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:42.221436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.221392    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:42.221436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.221421    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:22:42.325359 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.325330    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:22:42.328270 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:42.328241    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9480e89b_4c84_4295_96c9_35a9913299d3.slice/crio-5ca3a947814d91b2fe84f332e146c6b8f1eadda70a50962225069979deb952f9 WatchSource:0}: Error finding container 5ca3a947814d91b2fe84f332e146c6b8f1eadda70a50962225069979deb952f9: Status 404 returned error can't find the container with id 5ca3a947814d91b2fe84f332e146c6b8f1eadda70a50962225069979deb952f9
Sep 15 20:22:42.380498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.380468    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" event={"ID":"9480e89b-4c84-4295-96c9-35a9913299d3","Type":"ContainerStarted","Data":"5ca3a947814d91b2fe84f332e146c6b8f1eadda70a50962225069979deb952f9"}
Sep 15 20:22:42.382421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.382302    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerStarted","Data":"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"}
Sep 15 20:22:42.382421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.382378    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerStarted","Data":"4dfa1ed56fe909425bb584e10c77149e180c0b29b93b0179823ba1071a6ae928"}
Sep 15 20:22:42.404258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.404198    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podStartSLOduration=1.404174517 podStartE2EDuration="1.404174517s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:42.402834602 +0000 UTC m=+1056.847793613" watchObservedRunningTime="2026-09-15 20:22:42.404174517 +0000 UTC m=+1056.849133526"
Sep 15 20:22:42.935108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:42.935077    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:43.390950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:43.390908    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" event={"ID":"9480e89b-4c84-4295-96c9-35a9913299d3","Type":"ContainerStarted","Data":"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"}
Sep 15 20:22:43.408842 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:43.408785    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" podStartSLOduration=2.408770016 podStartE2EDuration="2.408770016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:43.406509967 +0000 UTC m=+1057.851468991" watchObservedRunningTime="2026-09-15 20:22:43.408770016 +0000 UTC m=+1057.853729024"
Sep 15 20:22:43.940413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:43.940377    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:44.399105 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:44.399066    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:44.402170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:44.402124    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:22:46.171487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.171423    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:46.230098 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230061    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230124    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230144    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230193    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230209    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230224    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230257    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230302    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230334    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kjxzb\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb\") pod \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\" (UID: \"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0\") "
Sep 15 20:22:46.230549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230383    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:46.230549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230454    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:46.230749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230573    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:46.230749 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230681    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:22:46.230852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230750    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.230852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230763    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.230852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230772    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.230852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.230558    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:46.232630 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.232597    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:22:46.232630 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.232609    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:22:46.232630 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.232627    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:46.232810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.232678    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb" (OuterVolumeSpecName: "kube-api-access-kjxzb") pod "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" (UID: "adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0"). InnerVolumeSpecName "kube-api-access-kjxzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:22:46.331881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331845    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.331881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331874    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.331881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331883    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kjxzb\" (UniqueName: \"kubernetes.io/projected/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-kube-api-access-kjxzb\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.331881 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331894    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.332198 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331903    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.332198 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.331912    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:22:46.410254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.410217    2554 generic.go:356] "Generic (PLEG): container finished" podID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerID="22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f" exitCode=0
Sep 15 20:22:46.410464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.410272    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"
Sep 15 20:22:46.410464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.410307    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerDied","Data":"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"}
Sep 15 20:22:46.410464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.410358    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7" event={"ID":"adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0","Type":"ContainerDied","Data":"bcd64c9a2cb85def23d68c40a125366f6d7a8af3c505d5b4fbd847c7382415ae"}
Sep 15 20:22:46.410464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.410381    2554 scope.go:117] "RemoveContainer" containerID="22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"
Sep 15 20:22:46.419450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.419431    2554 scope.go:117] "RemoveContainer" containerID="c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"
Sep 15 20:22:46.427305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.427287    2554 scope.go:117] "RemoveContainer" containerID="22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"
Sep 15 20:22:46.427585 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:46.427564    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f\": container with ID starting with 22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f not found: ID does not exist" containerID="22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"
Sep 15 20:22:46.427625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.427595    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f"} err="failed to get container status \"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f\": rpc error: code = NotFound desc = could not find container \"22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f\": container with ID starting with 22f90f99834e9dc4565ddb836f33d3014342b470eb6cfa48543a9ca8e54e312f not found: ID does not exist"
Sep 15 20:22:46.427625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.427614    2554 scope.go:117] "RemoveContainer" containerID="c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"
Sep 15 20:22:46.427913 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:22:46.427882    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2\": container with ID starting with c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2 not found: ID does not exist" containerID="c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"
Sep 15 20:22:46.427960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.427920    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2"} err="failed to get container status \"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2\": rpc error: code = NotFound desc = could not find container \"c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2\": container with ID starting with c1f62afe27db6ebdb257f3fbf42bb10135cacca3943169e84cac6bb1675b6dc2 not found: ID does not exist"
Sep 15 20:22:46.433313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.433286    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:46.437722 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.437701    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-e0b5e00e-gw-openshift-default-655ffdd656-44vz7"]
Sep 15 20:22:46.713613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.713575    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:22:46.713912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.713899    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.713975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.713914    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.714042 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.713998    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.714042 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.714010    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.718190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.718172    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.721276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.721248    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-9baa771e\""
Sep 15 20:22:46.721419 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.721301    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-9baa771e-dockercfg-kp7nb\""
Sep 15 20:22:46.729702 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.729677    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:22:46.732911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.732889    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:22:46.733275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.733261    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.733334 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.733276    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" containerName="istio-proxy"
Sep 15 20:22:46.736175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.736159    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.746412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.746389    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:22:46.836449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.836402    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.836632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.836463    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mf22\" (UniqueName: \"kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.836632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.836605    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kdcl\" (UniqueName: \"kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.836787 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.836710    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.937458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.937425    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kdcl\" (UniqueName: \"kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.937646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.937470    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.937646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.937509    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.937646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.937528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mf22\" (UniqueName: \"kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.938317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.938290    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.938427 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.938291    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:46.952408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.952375    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mf22\" (UniqueName: \"kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22\") pod \"payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") " pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:46.953492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:46.953467    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kdcl\" (UniqueName: \"kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl\") pod \"payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:47.029200 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.029101    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:47.049447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.048150    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:47.324585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.324558    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:22:47.327189 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:47.327163    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b98c567_3753_449f_8964_e271ba974f41.slice/crio-9b7d67d2cb4ba44f8bc00ff36885e2c4ff062d24eac43e5eaea51bb3fa951a26 WatchSource:0}: Error finding container 9b7d67d2cb4ba44f8bc00ff36885e2c4ff062d24eac43e5eaea51bb3fa951a26: Status 404 returned error can't find the container with id 9b7d67d2cb4ba44f8bc00ff36885e2c4ff062d24eac43e5eaea51bb3fa951a26
Sep 15 20:22:47.337178 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.337155    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:22:47.340575 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:22:47.340551    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod776cddb5_c482_4afe_8f78_8f1e248a280b.slice/crio-5da2795d6feae6aedd3ca2d411524b02a7f25bf2fd2ed91518d0f6f65806256c WatchSource:0}: Error finding container 5da2795d6feae6aedd3ca2d411524b02a7f25bf2fd2ed91518d0f6f65806256c: Status 404 returned error can't find the container with id 5da2795d6feae6aedd3ca2d411524b02a7f25bf2fd2ed91518d0f6f65806256c
Sep 15 20:22:47.417975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.417932    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" event={"ID":"2b98c567-3753-449f-8964-e271ba974f41","Type":"ContainerStarted","Data":"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"}
Sep 15 20:22:47.418185 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.418014    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" event={"ID":"2b98c567-3753-449f-8964-e271ba974f41","Type":"ContainerStarted","Data":"9b7d67d2cb4ba44f8bc00ff36885e2c4ff062d24eac43e5eaea51bb3fa951a26"}
Sep 15 20:22:47.418185 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.418092    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:47.421217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.421191    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" event={"ID":"776cddb5-c482-4afe-8f78-8f1e248a280b","Type":"ContainerStarted","Data":"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"}
Sep 15 20:22:47.421361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.421242    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" event={"ID":"776cddb5-c482-4afe-8f78-8f1e248a280b","Type":"ContainerStarted","Data":"5da2795d6feae6aedd3ca2d411524b02a7f25bf2fd2ed91518d0f6f65806256c"}
Sep 15 20:22:47.421361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.421319    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:22:47.438344 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.438282    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" podStartSLOduration=1.438259564 podStartE2EDuration="1.438259564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:47.437039981 +0000 UTC m=+1061.881998984" watchObservedRunningTime="2026-09-15 20:22:47.438259564 +0000 UTC m=+1061.883218576"
Sep 15 20:22:47.462581 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:47.462520    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" podStartSLOduration=1.462499776 podStartE2EDuration="1.462499776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:22:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:22:47.460172971 +0000 UTC m=+1061.905131994" watchObservedRunningTime="2026-09-15 20:22:47.462499776 +0000 UTC m=+1061.907458826"
Sep 15 20:22:48.023873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:48.023838    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0" path="/var/lib/kubelet/pods/adcb4fa2-e4fa-428d-8f7a-a971f2fc78e0/volumes"
Sep 15 20:22:48.136661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:48.136631    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:22:52.042554 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:52.042524    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:52.042941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:52.042570    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:52.055092 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:52.055054    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:52.456479 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:52.456425    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:22:58.428471 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:58.428395    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:22:58.428832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:22:58.428552    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:23:07.571500 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:07.571452    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:23:09.530948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.530910    2554 generic.go:356] "Generic (PLEG): container finished" podID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerID="62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15" exitCode=0
Sep 15 20:23:09.530948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.530954    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerDied","Data":"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"}
Sep 15 20:23:09.531539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.531387    2554 scope.go:117] "RemoveContainer" containerID="62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"
Sep 15 20:23:09.532556 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.532528    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:09.532653 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.532638    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:09.532692 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.532673    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:09.588069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.588043    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"]
Sep 15 20:23:09.592854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.592831    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:09.595552 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.595530    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:23:09.595768 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.595565    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:23:09.601778 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.601716    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"]
Sep 15 20:23:09.657512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.657471    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2\" (UID: \"824678d1-dce3-4312-b822-04a7447859c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:09.759066 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.759024    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2\" (UID: \"824678d1-dce3-4312-b822-04a7447859c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:09.759715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.759688    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2\" (UID: \"824678d1-dce3-4312-b822-04a7447859c0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:09.906701 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:09.906600    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:10.180580 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.180553    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"]
Sep 15 20:23:10.182307 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:10.182272    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824678d1_dce3_4312_b822_04a7447859c0.slice/crio-5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a WatchSource:0}: Error finding container 5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a: Status 404 returned error can't find the container with id 5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a
Sep 15 20:23:10.544008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.541328    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerStarted","Data":"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"}
Sep 15 20:23:10.544482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.544165    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2" event={"ID":"824678d1-dce3-4312-b822-04a7447859c0","Type":"ContainerStarted","Data":"5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a"}
Sep 15 20:23:10.937215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.936636    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:10.937215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.936784    2554 patch_prober.go:28] interesting pod/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 15 20:23:10.937215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:10.936831    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 15 20:23:11.554652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:11.554258    2554 generic.go:356] "Generic (PLEG): container finished" podID="824678d1-dce3-4312-b822-04a7447859c0" containerID="6554914bfc70628a56885b9fdb20e6a796cbf1eb4bc4249fcdf9dc0df35bfe2b" exitCode=0
Sep 15 20:23:11.555654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:11.554352    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2" event={"ID":"824678d1-dce3-4312-b822-04a7447859c0","Type":"ContainerDied","Data":"6554914bfc70628a56885b9fdb20e6a796cbf1eb4bc4249fcdf9dc0df35bfe2b"}
Sep 15 20:23:11.935567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:11.935455    2554 patch_prober.go:28] interesting pod/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 15 20:23:11.935567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:11.935531    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 15 20:23:12.714072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.714040    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:12.788669 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.788629    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca\") pod \"824678d1-dce3-4312-b822-04a7447859c0\" (UID: \"824678d1-dce3-4312-b822-04a7447859c0\") "
Sep 15 20:23:12.789009 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.788967    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "824678d1-dce3-4312-b822-04a7447859c0" (UID: "824678d1-dce3-4312-b822-04a7447859c0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:12.789424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.789399    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/824678d1-dce3-4312-b822-04a7447859c0-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:12.934720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.934604    2554 patch_prober.go:28] interesting pod/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 15 20:23:12.934720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:12.934683    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 15 20:23:13.567177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:13.567134    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2" event={"ID":"824678d1-dce3-4312-b822-04a7447859c0","Type":"ContainerDied","Data":"5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a"}
Sep 15 20:23:13.567177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:13.567160    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"
Sep 15 20:23:13.567459 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:13.567195    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5246a2d95988becc6776a9134923409baf21cef49a5dba63ba0e85471b94fc2a"
Sep 15 20:23:13.935422 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:13.935316    2554 patch_prober.go:28] interesting pod/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 15 20:23:13.935422 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:13.935392    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 15 20:23:14.399278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:14.399238    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:14.934746 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:14.934703    2554 patch_prober.go:28] interesting pod/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused" start-of-body=
Sep 15 20:23:14.934966 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:14.934782    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.37:15021/healthz/ready\": dial tcp 10.134.0.37:15021: connect: connection refused"
Sep 15 20:23:15.939190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:15.939158    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:15.940308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:15.940288    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:16.012342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.012308    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:23:16.012570 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.012543    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" podUID="2b98c567-3753-449f-8964-e271ba974f41" containerName="payload-processing" containerID="cri-o://44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5" gracePeriod=30
Sep 15 20:23:16.032018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.031968    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:23:16.032282 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.032210    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" podUID="776cddb5-c482-4afe-8f78-8f1e248a280b" containerName="payload-pre-processing" containerID="cri-o://f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9" gracePeriod=30
Sep 15 20:23:16.224813 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.224751    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"]
Sep 15 20:23:16.226820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.226796    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-9baa771e-4h6r2"]
Sep 15 20:23:16.294788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.294768    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:23:16.305397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.305375    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:23:16.321775 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.321749    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume\") pod \"2b98c567-3753-449f-8964-e271ba974f41\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") "
Sep 15 20:23:16.321891 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.321815    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mf22\" (UniqueName: \"kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22\") pod \"2b98c567-3753-449f-8964-e271ba974f41\" (UID: \"2b98c567-3753-449f-8964-e271ba974f41\") "
Sep 15 20:23:16.322210 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.322180    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2b98c567-3753-449f-8964-e271ba974f41" (UID: "2b98c567-3753-449f-8964-e271ba974f41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:16.324397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.324358    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22" (OuterVolumeSpecName: "kube-api-access-2mf22") pod "2b98c567-3753-449f-8964-e271ba974f41" (UID: "2b98c567-3753-449f-8964-e271ba974f41"). InnerVolumeSpecName "kube-api-access-2mf22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:16.423452 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.423415    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume\") pod \"776cddb5-c482-4afe-8f78-8f1e248a280b\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") "
Sep 15 20:23:16.423452 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.423458    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kdcl\" (UniqueName: \"kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl\") pod \"776cddb5-c482-4afe-8f78-8f1e248a280b\" (UID: \"776cddb5-c482-4afe-8f78-8f1e248a280b\") "
Sep 15 20:23:16.423709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.423658    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2b98c567-3753-449f-8964-e271ba974f41-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:16.423709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.423670    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mf22\" (UniqueName: \"kubernetes.io/projected/2b98c567-3753-449f-8964-e271ba974f41-kube-api-access-2mf22\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:16.423878 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.423846    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "776cddb5-c482-4afe-8f78-8f1e248a280b" (UID: "776cddb5-c482-4afe-8f78-8f1e248a280b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:16.425538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.425510    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl" (OuterVolumeSpecName: "kube-api-access-2kdcl") pod "776cddb5-c482-4afe-8f78-8f1e248a280b" (UID: "776cddb5-c482-4afe-8f78-8f1e248a280b"). InnerVolumeSpecName "kube-api-access-2kdcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:16.524605 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.524559    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/776cddb5-c482-4afe-8f78-8f1e248a280b-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:16.524605 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.524591    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kdcl\" (UniqueName: \"kubernetes.io/projected/776cddb5-c482-4afe-8f78-8f1e248a280b-kube-api-access-2kdcl\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:16.585880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.585844    2554 generic.go:356] "Generic (PLEG): container finished" podID="776cddb5-c482-4afe-8f78-8f1e248a280b" containerID="f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9" exitCode=0
Sep 15 20:23:16.586121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.585894    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"
Sep 15 20:23:16.586121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.585938    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" event={"ID":"776cddb5-c482-4afe-8f78-8f1e248a280b","Type":"ContainerDied","Data":"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"}
Sep 15 20:23:16.586121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.586019    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s" event={"ID":"776cddb5-c482-4afe-8f78-8f1e248a280b","Type":"ContainerDied","Data":"5da2795d6feae6aedd3ca2d411524b02a7f25bf2fd2ed91518d0f6f65806256c"}
Sep 15 20:23:16.586121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.586051    2554 scope.go:117] "RemoveContainer" containerID="f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"
Sep 15 20:23:16.587362 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.587341    2554 generic.go:356] "Generic (PLEG): container finished" podID="2b98c567-3753-449f-8964-e271ba974f41" containerID="44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5" exitCode=0
Sep 15 20:23:16.587449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.587385    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"
Sep 15 20:23:16.587449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.587413    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" event={"ID":"2b98c567-3753-449f-8964-e271ba974f41","Type":"ContainerDied","Data":"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"}
Sep 15 20:23:16.587550 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.587457    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q" event={"ID":"2b98c567-3753-449f-8964-e271ba974f41","Type":"ContainerDied","Data":"9b7d67d2cb4ba44f8bc00ff36885e2c4ff062d24eac43e5eaea51bb3fa951a26"}
Sep 15 20:23:16.595480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.595461    2554 scope.go:117] "RemoveContainer" containerID="f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"
Sep 15 20:23:16.595818 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:23:16.595796    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9\": container with ID starting with f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9 not found: ID does not exist" containerID="f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"
Sep 15 20:23:16.595888 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.595826    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9"} err="failed to get container status \"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9\": rpc error: code = NotFound desc = could not find container \"f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9\": container with ID starting with f49902e96c809d573f87ed74d5d7f763b8f9fdb86ca2d42c7c095f9e59b260d9 not found: ID does not exist"
Sep 15 20:23:16.595888 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.595844    2554 scope.go:117] "RemoveContainer" containerID="44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"
Sep 15 20:23:16.604043 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.604019    2554 scope.go:117] "RemoveContainer" containerID="44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"
Sep 15 20:23:16.604344 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:23:16.604324    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5\": container with ID starting with 44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5 not found: ID does not exist" containerID="44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"
Sep 15 20:23:16.604413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.604351    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5"} err="failed to get container status \"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5\": rpc error: code = NotFound desc = could not find container \"44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5\": container with ID starting with 44290e2980e5731d86d92c8ba003543f7f8b4778e869ad0974dfab7c6e77dfd5 not found: ID does not exist"
Sep 15 20:23:16.611845 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.611820    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:23:16.616735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.616707    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-9baa771e-6999b97f65-5z79q"]
Sep 15 20:23:16.627370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.627347    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:23:16.633877 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:16.633855    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-9baa771e-56645c5b98-nl56s"]
Sep 15 20:23:17.610912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:17.610879    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:23:17.611379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:17.611119    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy" containerID="cri-o://617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2" gracePeriod=30
Sep 15 20:23:18.023465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.023431    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b98c567-3753-449f-8964-e271ba974f41" path="/var/lib/kubelet/pods/2b98c567-3753-449f-8964-e271ba974f41/volumes"
Sep 15 20:23:18.023818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.023805    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="776cddb5-c482-4afe-8f78-8f1e248a280b" path="/var/lib/kubelet/pods/776cddb5-c482-4afe-8f78-8f1e248a280b/volumes"
Sep 15 20:23:18.024129 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.024117    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824678d1-dce3-4312-b822-04a7447859c0" path="/var/lib/kubelet/pods/824678d1-dce3-4312-b822-04a7447859c0/volumes"
Sep 15 20:23:18.492852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.492816    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:23:18.493277 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493256    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824678d1-dce3-4312-b822-04a7447859c0" containerName="revoke-keys"
Sep 15 20:23:18.493277 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493276    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="824678d1-dce3-4312-b822-04a7447859c0" containerName="revoke-keys"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493288    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b98c567-3753-449f-8964-e271ba974f41" containerName="payload-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493296    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b98c567-3753-449f-8964-e271ba974f41" containerName="payload-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493312    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="776cddb5-c482-4afe-8f78-8f1e248a280b" containerName="payload-pre-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493321    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="776cddb5-c482-4afe-8f78-8f1e248a280b" containerName="payload-pre-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493396    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="776cddb5-c482-4afe-8f78-8f1e248a280b" containerName="payload-pre-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493405    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b98c567-3753-449f-8964-e271ba974f41" containerName="payload-processing"
Sep 15 20:23:18.493445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.493418    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="824678d1-dce3-4312-b822-04a7447859c0" containerName="revoke-keys"
Sep 15 20:23:18.497901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.497881    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.501836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.501815    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-93ab770e-openshift-default-dockercfg-lwjdt\""
Sep 15 20:23:18.524938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.524893    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:23:18.544418 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544382    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544418 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544431    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544486    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544534    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544573    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544590    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544616    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544660 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544647    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.544870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.544702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkt8m\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.645341 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.645291    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.645967 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.645939    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.646151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.646132    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.646275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.646258    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.646406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.646387    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.646547 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.646528    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkt8m\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.647412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.647388    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.647585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.647566    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.647713 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.647698    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.648449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.648427    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.648815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.648797    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.648939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.648812    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.649480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.649449    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.649930 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.649903    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.652676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.652625    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.653319 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.653297    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.677089 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.677022    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkt8m\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.678640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.678587    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token\") pod \"e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") " pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:18.807918 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:18.807829    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:19.083238 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.083207    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:23:19.085050 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:19.085024    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcbab37c_ee62_446d_8437_e5b7dfdd7830.slice/crio-8a99942f10a425b3ff571e3f08b7fe6c7843f826443dced0948e17ac601b485b WatchSource:0}: Error finding container 8a99942f10a425b3ff571e3f08b7fe6c7843f826443dced0948e17ac601b485b: Status 404 returned error can't find the container with id 8a99942f10a425b3ff571e3f08b7fe6c7843f826443dced0948e17ac601b485b
Sep 15 20:23:19.087312 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.087274    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:19.087399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.087362    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:19.087469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.087408    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:19.606586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.606541    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerStarted","Data":"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"}
Sep 15 20:23:19.606789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.606598    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerStarted","Data":"8a99942f10a425b3ff571e3f08b7fe6c7843f826443dced0948e17ac601b485b"}
Sep 15 20:23:19.630931 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.630881    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podStartSLOduration=1.630863465 podStartE2EDuration="1.630863465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:23:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:23:19.629566568 +0000 UTC m=+1094.074525571" watchObservedRunningTime="2026-09-15 20:23:19.630863465 +0000 UTC m=+1094.075822476"
Sep 15 20:23:19.808301 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:19.808254    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:20.814284 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:20.814252    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:21.616413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:21.616372    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:21.617491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:21.617467    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:22.868327 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.868300    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:22.992107 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992070    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992107 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992108    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992131    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992152    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992178    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992229    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992273    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kfqct\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992347    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992376    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket\") pod \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\" (UID: \"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04\") "
Sep 15 20:23:22.992651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992433    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data" (OuterVolumeSpecName: "istio-data") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:23:22.992651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992451    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:23:22.992824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992676    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:23:22.992824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992679    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:22.992824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992462    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:23:22.992824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992803    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:22.992824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992821    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:22.993116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992836    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:22.993116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992848    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:22.993116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.992860    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:22.994524 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.994491    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token" (OuterVolumeSpecName: "istio-token") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:22.994656 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.994591    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:23:22.994741 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.994719    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:23:22.994839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:22.994821    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct" (OuterVolumeSpecName: "kube-api-access-kfqct") pod "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" (UID: "0a486323-fb29-4c2f-ac1a-6bfd18b4fc04"). InnerVolumeSpecName "kube-api-access-kfqct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:23.093724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.093680    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:23.093724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.093717    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kfqct\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-kube-api-access-kfqct\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:23.093724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.093728    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:23.093971 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.093737    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:23.628679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.628641    2554 generic.go:356] "Generic (PLEG): container finished" podID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerID="617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2" exitCode=0
Sep 15 20:23:23.628856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.628717    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"
Sep 15 20:23:23.628856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.628725    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerDied","Data":"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"}
Sep 15 20:23:23.628856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.628805    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r" event={"ID":"0a486323-fb29-4c2f-ac1a-6bfd18b4fc04","Type":"ContainerDied","Data":"4dfa1ed56fe909425bb584e10c77149e180c0b29b93b0179823ba1071a6ae928"}
Sep 15 20:23:23.628856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.628828    2554 scope.go:117] "RemoveContainer" containerID="617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"
Sep 15 20:23:23.638375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.638354    2554 scope.go:117] "RemoveContainer" containerID="62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"
Sep 15 20:23:23.646808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.646785    2554 scope.go:117] "RemoveContainer" containerID="617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"
Sep 15 20:23:23.647204 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:23:23.647186    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2\": container with ID starting with 617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2 not found: ID does not exist" containerID="617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"
Sep 15 20:23:23.647267 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.647215    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2"} err="failed to get container status \"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2\": rpc error: code = NotFound desc = could not find container \"617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2\": container with ID starting with 617e68afd44c13308f863d7cb9d0af310b95b03d3820e4966a7dfb3aa397d7c2 not found: ID does not exist"
Sep 15 20:23:23.647267 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.647234    2554 scope.go:117] "RemoveContainer" containerID="62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"
Sep 15 20:23:23.647535 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:23:23.647501    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15\": container with ID starting with 62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15 not found: ID does not exist" containerID="62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"
Sep 15 20:23:23.647593 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.647540    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15"} err="failed to get container status \"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15\": rpc error: code = NotFound desc = could not find container \"62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15\": container with ID starting with 62ff8b09c16fe071cf45455df094082f13d3ea525a1814e63ef9b2f7a17b4f15 not found: ID does not exist"
Sep 15 20:23:23.650908 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.650880    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:23:23.658167 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:23.658138    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9baa771e-openshift-default-c4f45d874-78h8r"]
Sep 15 20:23:24.024285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:24.024249    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" path="/var/lib/kubelet/pods/0a486323-fb29-4c2f-ac1a-6bfd18b4fc04/volumes"
Sep 15 20:23:24.330999 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:24.330895    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:23:26.590548 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590513    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:26.590922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590848    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.590922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590859    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.590922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590876    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.590922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590881    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.591097 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590937    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.591097 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.590944    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a486323-fb29-4c2f-ac1a-6bfd18b4fc04" containerName="istio-proxy"
Sep 15 20:23:26.595129 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.595111    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.597780 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.597756    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-93ab770e-dockercfg-db7d6\""
Sep 15 20:23:26.597780 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.597774    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-93ab770e\""
Sep 15 20:23:26.605262 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.605236    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:26.629218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.629183    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:26.632566 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.632544    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.644517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.644490    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:26.731681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.731641    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88wvw\" (UniqueName: \"kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.731875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.731704    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5rdm\" (UniqueName: \"kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.731875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.731838    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.732034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.731881    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.832626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.832584    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.832777 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.832634    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.832777 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.832684    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-88wvw\" (UniqueName: \"kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.832777 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.832714    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5rdm\" (UniqueName: \"kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.833635 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.833609    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.833687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.833609    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.841245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.841180    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-88wvw\" (UniqueName: \"kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw\") pod \"payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:26.841364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.841344    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5rdm\" (UniqueName: \"kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm\") pod \"payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") " pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.906563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.906514    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:26.943033 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:26.943000    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:27.180194 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.180161    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:27.182441 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:27.182415    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca884eb3_d80e_4dad_84e7_4f9c5fd7d299.slice/crio-2d3124d3d756b7c19ca19a8b801d31b69efa03bbd1e6b8b4836119402a698ab6 WatchSource:0}: Error finding container 2d3124d3d756b7c19ca19a8b801d31b69efa03bbd1e6b8b4836119402a698ab6: Status 404 returned error can't find the container with id 2d3124d3d756b7c19ca19a8b801d31b69efa03bbd1e6b8b4836119402a698ab6
Sep 15 20:23:27.230910 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.230886    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:27.232286 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:27.232261    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4da32d70_3e2b_487c_83c0_0366ac690ac0.slice/crio-81f90a6fbb59eb70edf8981e9efeead039d793c09ee9759a9bbcdf3286fb06ea WatchSource:0}: Error finding container 81f90a6fbb59eb70edf8981e9efeead039d793c09ee9759a9bbcdf3286fb06ea: Status 404 returned error can't find the container with id 81f90a6fbb59eb70edf8981e9efeead039d793c09ee9759a9bbcdf3286fb06ea
Sep 15 20:23:27.653368 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.653316    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" event={"ID":"4da32d70-3e2b-487c-83c0-0366ac690ac0","Type":"ContainerStarted","Data":"3e1bf60e374f7263bf976a50d32dc8ad6b17ead5313ef0ccb0d024aef529d769"}
Sep 15 20:23:27.653847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.653395    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:27.653847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.653424    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" event={"ID":"4da32d70-3e2b-487c-83c0-0366ac690ac0","Type":"ContainerStarted","Data":"81f90a6fbb59eb70edf8981e9efeead039d793c09ee9759a9bbcdf3286fb06ea"}
Sep 15 20:23:27.655133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.655101    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" event={"ID":"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299","Type":"ContainerStarted","Data":"761d12ebf8743cf05bfae8684bfa4d5803198b9d3ad5d4b73bd62c2d4c16f903"}
Sep 15 20:23:27.655293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.655144    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" event={"ID":"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299","Type":"ContainerStarted","Data":"2d3124d3d756b7c19ca19a8b801d31b69efa03bbd1e6b8b4836119402a698ab6"}
Sep 15 20:23:27.655293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.655245    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:27.673062 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.673009    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" podStartSLOduration=1.67297725 podStartE2EDuration="1.67297725s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:23:27.671663733 +0000 UTC m=+1102.116622742" watchObservedRunningTime="2026-09-15 20:23:27.67297725 +0000 UTC m=+1102.117936321"
Sep 15 20:23:27.689320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:27.689264    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" podStartSLOduration=1.689246378 podStartE2EDuration="1.689246378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:23:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:23:27.688124513 +0000 UTC m=+1102.133083523" watchObservedRunningTime="2026-09-15 20:23:27.689246378 +0000 UTC m=+1102.134205386"
Sep 15 20:23:28.918696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:28.918658    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"]
Sep 15 20:23:28.922090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:28.922065    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:28.925072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:28.925043    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:23:28.925193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:28.925100    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:23:28.931791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:28.931763    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"]
Sep 15 20:23:29.054779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.054738    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8\" (UID: \"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:29.156301 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.156261    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8\" (UID: \"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:29.157362 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.157334    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8\" (UID: \"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:29.234511 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.234472    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:29.517120 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.517095    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"]
Sep 15 20:23:29.519261 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:29.519225    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dd4e2e8_dd26_49fd_8f9a_0a16791326ce.slice/crio-95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177 WatchSource:0}: Error finding container 95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177: Status 404 returned error can't find the container with id 95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177
Sep 15 20:23:29.667946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:29.667915    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8" event={"ID":"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce","Type":"ContainerStarted","Data":"95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177"}
Sep 15 20:23:30.674732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:30.674637    2554 generic.go:356] "Generic (PLEG): container finished" podID="8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" containerID="0b994e81ca3544737a4cc6cc63ba61ecfa5eb53af2932e6e98d8d3a2c3f68916" exitCode=0
Sep 15 20:23:30.674732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:30.674701    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8" event={"ID":"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce","Type":"ContainerDied","Data":"0b994e81ca3544737a4cc6cc63ba61ecfa5eb53af2932e6e98d8d3a2c3f68916"}
Sep 15 20:23:31.816706 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:31.816679    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:31.881872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:31.881837    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca\") pod \"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce\" (UID: \"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce\") "
Sep 15 20:23:31.882290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:31.882270    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" (UID: "8dd4e2e8-dd26-49fd-8f9a-0a16791326ce"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:31.983269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:31.983231    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:32.686869 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:32.686834    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8" event={"ID":"8dd4e2e8-dd26-49fd-8f9a-0a16791326ce","Type":"ContainerDied","Data":"95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177"}
Sep 15 20:23:32.687038 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:32.686892    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="95a66f92a069947f23b438d5cef19b32ce5f8b1c775f26fdb7a2d7844b021177"
Sep 15 20:23:32.687038 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:32.686846    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"
Sep 15 20:23:38.662070 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:38.662033    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:38.662600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:38.662102    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:39.623425 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:39.623387    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"]
Sep 15 20:23:39.625489 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:39.625457    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-30d5aa-jrnc8"]
Sep 15 20:23:40.023917 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:40.023882    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" path="/var/lib/kubelet/pods/8dd4e2e8-dd26-49fd-8f9a-0a16791326ce/volumes"
Sep 15 20:23:45.390818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.390782    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:23:45.835116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.835078    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"]
Sep 15 20:23:45.835444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.835432    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" containerName="revoke-keys"
Sep 15 20:23:45.835490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.835445    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" containerName="revoke-keys"
Sep 15 20:23:45.835526 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.835499    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8dd4e2e8-dd26-49fd-8f9a-0a16791326ce" containerName="revoke-keys"
Sep 15 20:23:45.838523 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.838504    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:45.842230 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.842211    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:23:45.842346 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.842236    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:23:45.846797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.846775    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"]
Sep 15 20:23:45.929389 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:45.929352    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc\" (UID: \"4426f5ab-c2a9-4b64-876c-107874baaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:46.030159 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.030123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc\" (UID: \"4426f5ab-c2a9-4b64-876c-107874baaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:46.030814 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.030795    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc\" (UID: \"4426f5ab-c2a9-4b64-876c-107874baaf63\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:46.150791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.150700    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:46.425850 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.425768    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"]
Sep 15 20:23:46.429598 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:23:46.429569    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4426f5ab_c2a9_4b64_876c_107874baaf63.slice/crio-995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10 WatchSource:0}: Error finding container 995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10: Status 404 returned error can't find the container with id 995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10
Sep 15 20:23:46.773053 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.773008    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc" event={"ID":"4426f5ab-c2a9-4b64-876c-107874baaf63","Type":"ContainerStarted","Data":"53ee452bd6ad1cddc2ef60ddace5069654199fedb74ef53624e811518d8abefa"}
Sep 15 20:23:46.773281 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.773078    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc" event={"ID":"4426f5ab-c2a9-4b64-876c-107874baaf63","Type":"ContainerStarted","Data":"995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10"}
Sep 15 20:23:46.789386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:46.789157    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc" podStartSLOduration=1.7891375059999999 podStartE2EDuration="1.789137506s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:23:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:23:46.788472079 +0000 UTC m=+1121.233431087" watchObservedRunningTime="2026-09-15 20:23:46.789137506 +0000 UTC m=+1121.234096517"
Sep 15 20:23:47.779626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.779588    2554 generic.go:356] "Generic (PLEG): container finished" podID="4426f5ab-c2a9-4b64-876c-107874baaf63" containerID="53ee452bd6ad1cddc2ef60ddace5069654199fedb74ef53624e811518d8abefa" exitCode=0
Sep 15 20:23:47.780112 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.779683    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc" event={"ID":"4426f5ab-c2a9-4b64-876c-107874baaf63","Type":"ContainerDied","Data":"53ee452bd6ad1cddc2ef60ddace5069654199fedb74ef53624e811518d8abefa"}
Sep 15 20:23:47.781392 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.781371    2554 generic.go:356] "Generic (PLEG): container finished" podID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerID="cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411" exitCode=0
Sep 15 20:23:47.781461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.781440    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerDied","Data":"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"}
Sep 15 20:23:47.781886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.781872    2554 scope.go:117] "RemoveContainer" containerID="cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"
Sep 15 20:23:47.783215 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.783184    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:47.783335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.783253    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:47.783335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:47.783284    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:23:48.788593 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.788560    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerStarted","Data":"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"}
Sep 15 20:23:48.808371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.808336    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:48.809590 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.809558    2554 patch_prober.go:28] interesting pod/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 20:23:48.809768 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.809609    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 20:23:48.922162 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.922137    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:48.963303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.963270    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca\") pod \"4426f5ab-c2a9-4b64-876c-107874baaf63\" (UID: \"4426f5ab-c2a9-4b64-876c-107874baaf63\") "
Sep 15 20:23:48.963643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:48.963618    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4426f5ab-c2a9-4b64-876c-107874baaf63" (UID: "4426f5ab-c2a9-4b64-876c-107874baaf63"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:49.065043 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.064915    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4426f5ab-c2a9-4b64-876c-107874baaf63-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:49.795282 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.795253    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"
Sep 15 20:23:49.795727 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.795297    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc" event={"ID":"4426f5ab-c2a9-4b64-876c-107874baaf63","Type":"ContainerDied","Data":"995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10"}
Sep 15 20:23:49.795727 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.795354    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="995aa327c8c28cba23a1acb4b99eb18cfe92ecfc64f26cb9e3c4d8c4045cdc10"
Sep 15 20:23:49.808519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.808491    2554 patch_prober.go:28] interesting pod/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 20:23:49.808652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:49.808541    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 20:23:50.809241 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:50.809201    2554 patch_prober.go:28] interesting pod/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 20:23:50.809657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:50.809270    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 20:23:51.616797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:51.616756    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:23:51.808364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:51.808326    2554 patch_prober.go:28] interesting pod/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 20:23:51.808544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:51.808382    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 20:23:52.669829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.669785    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:52.671320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.671277    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" podUID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" containerName="payload-processing" containerID="cri-o://761d12ebf8743cf05bfae8684bfa4d5803198b9d3ad5d4b73bd62c2d4c16f903" gracePeriod=30
Sep 15 20:23:52.684478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.683405    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:52.684478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.683660    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" podUID="4da32d70-3e2b-487c-83c0-0366ac690ac0" containerName="payload-pre-processing" containerID="cri-o://3e1bf60e374f7263bf976a50d32dc8ad6b17ead5313ef0ccb0d024aef529d769" gracePeriod=30
Sep 15 20:23:52.809018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.808563    2554 patch_prober.go:28] interesting pod/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 20:23:52.809018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.808656    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 20:23:52.814335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.814304    2554 generic.go:356] "Generic (PLEG): container finished" podID="4da32d70-3e2b-487c-83c0-0366ac690ac0" containerID="3e1bf60e374f7263bf976a50d32dc8ad6b17ead5313ef0ccb0d024aef529d769" exitCode=0
Sep 15 20:23:52.814478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.814397    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" event={"ID":"4da32d70-3e2b-487c-83c0-0366ac690ac0","Type":"ContainerDied","Data":"3e1bf60e374f7263bf976a50d32dc8ad6b17ead5313ef0ccb0d024aef529d769"}
Sep 15 20:23:52.815968 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.815946    2554 generic.go:356] "Generic (PLEG): container finished" podID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" containerID="761d12ebf8743cf05bfae8684bfa4d5803198b9d3ad5d4b73bd62c2d4c16f903" exitCode=0
Sep 15 20:23:52.816060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.816046    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" event={"ID":"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299","Type":"ContainerDied","Data":"761d12ebf8743cf05bfae8684bfa4d5803198b9d3ad5d4b73bd62c2d4c16f903"}
Sep 15 20:23:52.842005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.839592    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"]
Sep 15 20:23:52.856006 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.854399    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-93ab770e-8rhlc"]
Sep 15 20:23:52.982406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.981517    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:23:52.982406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:52.981779    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy" containerID="cri-o://53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188" gracePeriod=30
Sep 15 20:23:53.015308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.015276    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:53.064052 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.063622    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:53.113098 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.112923    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5rdm\" (UniqueName: \"kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm\") pod \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") "
Sep 15 20:23:53.113407 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.113378    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88wvw\" (UniqueName: \"kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw\") pod \"4da32d70-3e2b-487c-83c0-0366ac690ac0\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") "
Sep 15 20:23:53.114049 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.114028    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume\") pod \"4da32d70-3e2b-487c-83c0-0366ac690ac0\" (UID: \"4da32d70-3e2b-487c-83c0-0366ac690ac0\") "
Sep 15 20:23:53.114680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.114662    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume\") pod \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\" (UID: \"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299\") "
Sep 15 20:23:53.115643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.114585    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4da32d70-3e2b-487c-83c0-0366ac690ac0" (UID: "4da32d70-3e2b-487c-83c0-0366ac690ac0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:53.115773 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.115617    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" (UID: "ca884eb3-d80e-4dad-84e7-4f9c5fd7d299"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:23:53.116745 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.116707    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw" (OuterVolumeSpecName: "kube-api-access-88wvw") pod "4da32d70-3e2b-487c-83c0-0366ac690ac0" (UID: "4da32d70-3e2b-487c-83c0-0366ac690ac0"). InnerVolumeSpecName "kube-api-access-88wvw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:53.117672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.117647    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm" (OuterVolumeSpecName: "kube-api-access-b5rdm") pod "ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" (UID: "ca884eb3-d80e-4dad-84e7-4f9c5fd7d299"). InnerVolumeSpecName "kube-api-access-b5rdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:23:53.216441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.216402    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5rdm\" (UniqueName: \"kubernetes.io/projected/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-kube-api-access-b5rdm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:53.216441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.216436    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88wvw\" (UniqueName: \"kubernetes.io/projected/4da32d70-3e2b-487c-83c0-0366ac690ac0-kube-api-access-88wvw\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:53.216441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.216445    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4da32d70-3e2b-487c-83c0-0366ac690ac0-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:53.216441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.216453    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:23:53.822199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.822167    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"
Sep 15 20:23:53.822199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.822191    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9" event={"ID":"4da32d70-3e2b-487c-83c0-0366ac690ac0","Type":"ContainerDied","Data":"81f90a6fbb59eb70edf8981e9efeead039d793c09ee9759a9bbcdf3286fb06ea"}
Sep 15 20:23:53.822756 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.822256    2554 scope.go:117] "RemoveContainer" containerID="3e1bf60e374f7263bf976a50d32dc8ad6b17ead5313ef0ccb0d024aef529d769"
Sep 15 20:23:53.823685 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.823646    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv" event={"ID":"ca884eb3-d80e-4dad-84e7-4f9c5fd7d299","Type":"ContainerDied","Data":"2d3124d3d756b7c19ca19a8b801d31b69efa03bbd1e6b8b4836119402a698ab6"}
Sep 15 20:23:53.823685 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.823678    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"
Sep 15 20:23:53.831245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.831224    2554 scope.go:117] "RemoveContainer" containerID="761d12ebf8743cf05bfae8684bfa4d5803198b9d3ad5d4b73bd62c2d4c16f903"
Sep 15 20:23:53.861359 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.861320    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:53.865825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.865800    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-93ab770e-769c6cf686-8cds9"]
Sep 15 20:23:53.879970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.879928    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:53.882336 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:53.882309    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-93ab770e-65c87fd47c-4bnfv"]
Sep 15 20:23:54.023902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:54.023856    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4426f5ab-c2a9-4b64-876c-107874baaf63" path="/var/lib/kubelet/pods/4426f5ab-c2a9-4b64-876c-107874baaf63/volumes"
Sep 15 20:23:54.024318 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:54.024296    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4da32d70-3e2b-487c-83c0-0366ac690ac0" path="/var/lib/kubelet/pods/4da32d70-3e2b-487c-83c0-0366ac690ac0/volumes"
Sep 15 20:23:54.024704 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:23:54.024687    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" path="/var/lib/kubelet/pods/ca884eb3-d80e-4dad-84e7-4f9c5fd7d299/volumes"
Sep 15 20:24:00.281563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.281527    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:24:00.384826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384717    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.384826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384783    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.384826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384803    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hkt8m\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.384826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384820    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384858    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384911    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.384957    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385039    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385072    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo\") pod \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\" (UID: \"dcbab37c-ee62-446d-8437-e5b7dfdd7830\") "
Sep 15 20:24:00.385211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385170    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:00.385481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385253    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:00.385481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385320    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data" (OuterVolumeSpecName: "istio-data") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:00.385481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385431    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:00.385481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385472    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.385809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385492    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.385809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385508    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.385921 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.385822    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:24:00.387160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.387133    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:00.387285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.387265    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m" (OuterVolumeSpecName: "kube-api-access-hkt8m") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "kube-api-access-hkt8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:24:00.387619 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.387588    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token" (OuterVolumeSpecName: "istio-token") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:24:00.387619 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.387581    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dcbab37c-ee62-446d-8437-e5b7dfdd7830" (UID: "dcbab37c-ee62-446d-8437-e5b7dfdd7830"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:24:00.486900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486854    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.486900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486892    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.486900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486902    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.486900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486911    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hkt8m\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-kube-api-access-hkt8m\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.487236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486921    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcbab37c-ee62-446d-8437-e5b7dfdd7830-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.487236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.486930    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcbab37c-ee62-446d-8437-e5b7dfdd7830-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:00.864382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.864344    2554 generic.go:356] "Generic (PLEG): container finished" podID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerID="53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188" exitCode=0
Sep 15 20:24:00.864569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.864396    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"
Sep 15 20:24:00.864569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.864431    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerDied","Data":"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"}
Sep 15 20:24:00.864569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.864490    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx" event={"ID":"dcbab37c-ee62-446d-8437-e5b7dfdd7830","Type":"ContainerDied","Data":"8a99942f10a425b3ff571e3f08b7fe6c7843f826443dced0948e17ac601b485b"}
Sep 15 20:24:00.864569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.864523    2554 scope.go:117] "RemoveContainer" containerID="53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"
Sep 15 20:24:00.873785 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.873764    2554 scope.go:117] "RemoveContainer" containerID="cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"
Sep 15 20:24:00.882194 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.882172    2554 scope.go:117] "RemoveContainer" containerID="53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"
Sep 15 20:24:00.882519 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:24:00.882499    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188\": container with ID starting with 53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188 not found: ID does not exist" containerID="53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"
Sep 15 20:24:00.882572 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.882530    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188"} err="failed to get container status \"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188\": rpc error: code = NotFound desc = could not find container \"53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188\": container with ID starting with 53fc4a3422c826e384936523cdb6e61a7ef37ee30a0a7eb90f571c2484f3b188 not found: ID does not exist"
Sep 15 20:24:00.882572 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.882553    2554 scope.go:117] "RemoveContainer" containerID="cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"
Sep 15 20:24:00.882833 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:24:00.882814    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411\": container with ID starting with cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411 not found: ID does not exist" containerID="cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"
Sep 15 20:24:00.882886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.882844    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411"} err="failed to get container status \"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411\": rpc error: code = NotFound desc = could not find container \"cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411\": container with ID starting with cca5477f18d2d69ef465c0fb59427495fec29ad9c31d58a4be9fd68de9c85411 not found: ID does not exist"
Sep 15 20:24:00.886126 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.886099    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:24:00.892571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:00.892545    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-93ab770e-openshift-default-5fdff87dc6-4qgjx"]
Sep 15 20:24:02.028901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:02.028863    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" path="/var/lib/kubelet/pods/dcbab37c-ee62-446d-8437-e5b7dfdd7830/volumes"
Sep 15 20:24:06.331643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:06.331546    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:24:22.271029 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:22.270977    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:24:22.271618 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:22.271236    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" containerID="cri-o://b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903" gracePeriod=30
Sep 15 20:24:22.853856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:22.853809    2554 patch_prober.go:28] interesting pod/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 20:24:22.854058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:22.853887    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 20:24:23.028478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.028442    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:24:23.028989 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.028953    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" containerName="payload-processing"
Sep 15 20:24:23.029151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029139    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" containerName="payload-processing"
Sep 15 20:24:23.029240 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029231    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:23.029306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029298    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:23.029376 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029368    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4da32d70-3e2b-487c-83c0-0366ac690ac0" containerName="payload-pre-processing"
Sep 15 20:24:23.029440 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029432    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4da32d70-3e2b-487c-83c0-0366ac690ac0" containerName="payload-pre-processing"
Sep 15 20:24:23.029503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029495    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4426f5ab-c2a9-4b64-876c-107874baaf63" containerName="revoke-keys"
Sep 15 20:24:23.029579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029570    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="4426f5ab-c2a9-4b64-876c-107874baaf63" containerName="revoke-keys"
Sep 15 20:24:23.029850 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029835    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:23.029941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.029932    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4426f5ab-c2a9-4b64-876c-107874baaf63" containerName="revoke-keys"
Sep 15 20:24:23.030033 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.030024    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca884eb3-d80e-4dad-84e7-4f9c5fd7d299" containerName="payload-processing"
Sep 15 20:24:23.030113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.030105    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="4da32d70-3e2b-487c-83c0-0366ac690ac0" containerName="payload-pre-processing"
Sep 15 20:24:23.036516 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.036494    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.039691 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.039667    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-5c37e0-openshift-default-dockercfg-t6w27\""
Sep 15 20:24:23.048246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.048158    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:24:23.198106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198019    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198064    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198088    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198112    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198139    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198220    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198244    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.198313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.198260    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcl5b\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299070 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299028    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299121    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299148    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299166    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcl5b\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299322    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299418    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299463    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299484    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299594    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299603    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299724    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299888    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.299970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.299894    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.301562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.301531    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.301668 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.301636    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.307802 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.307776    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.307937 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.307867    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcl5b\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b\") pod \"e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") " pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.358338 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.358296    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:23.636414 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.636386    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:24:23.638570 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:24:23.638544    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bd2806_2600_4a07_ad7d_0ae30ba35fe7.slice/crio-989d587b754a3d517f088ce0e41a983f01a04992d123c935cb4bf71fa1d2a75f WatchSource:0}: Error finding container 989d587b754a3d517f088ce0e41a983f01a04992d123c935cb4bf71fa1d2a75f: Status 404 returned error can't find the container with id 989d587b754a3d517f088ce0e41a983f01a04992d123c935cb4bf71fa1d2a75f
Sep 15 20:24:23.641232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.641198    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:23.641319 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.641266    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:23.641319 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.641297    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:23.987190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.987148    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerStarted","Data":"3c242a80401b3172c64515b02ac0b6f70b147fa3e6645d1cfc38c6d650a0151e"}
Sep 15 20:24:23.987378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:23.987239    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerStarted","Data":"989d587b754a3d517f088ce0e41a983f01a04992d123c935cb4bf71fa1d2a75f"}
Sep 15 20:24:24.007748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:24.007690    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podStartSLOduration=1.00767383 podStartE2EDuration="1.00767383s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:24:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:24:24.006818799 +0000 UTC m=+1158.451777808" watchObservedRunningTime="2026-09-15 20:24:24.00767383 +0000 UTC m=+1158.452632839"
Sep 15 20:24:24.358742 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:24.358645    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:24.364335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:24.364307    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:24.992799 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:24.992770    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:24.993844 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:24.993822    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:27.535790 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.535725    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:24:27.642700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642647    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpbz4\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642738    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642781    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642803    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642823    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642868    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.642957    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643027    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643058    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert\") pod \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\" (UID: \"ccf117cd-1021-4cf9-95a2-9d1ecec4f048\") "
Sep 15 20:24:27.643441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643073    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:27.643441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643165    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data" (OuterVolumeSpecName: "istio-data") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:27.643441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643180    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:27.643441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643385    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:27.643710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643458    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:24:27.643710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643471    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.643710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643495    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.643710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643510    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.643710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.643524    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.645163 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.645139    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:24:27.645285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.645160    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:24:27.645414 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.645394    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token" (OuterVolumeSpecName: "istio-token") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:24:27.645457 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.645420    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4" (OuterVolumeSpecName: "kube-api-access-cpbz4") pod "ccf117cd-1021-4cf9-95a2-9d1ecec4f048" (UID: "ccf117cd-1021-4cf9-95a2-9d1ecec4f048"). InnerVolumeSpecName "kube-api-access-cpbz4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:24:27.744559 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.744515    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.744559 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.744549    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.744559 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.744561    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpbz4\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-kube-api-access-cpbz4\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.744803 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.744571    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:27.744803 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:27.744580    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ccf117cd-1021-4cf9-95a2-9d1ecec4f048-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:24:28.008838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.008790    2554 generic.go:356] "Generic (PLEG): container finished" podID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerID="b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903" exitCode=0
Sep 15 20:24:28.008838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.008847    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"
Sep 15 20:24:28.009077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.008879    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerDied","Data":"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"}
Sep 15 20:24:28.009077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.008941    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk" event={"ID":"ccf117cd-1021-4cf9-95a2-9d1ecec4f048","Type":"ContainerDied","Data":"0b539e6206d208965c4196f0bd782bb1f3cdfa90d8a53ee9a5cb42651e91b563"}
Sep 15 20:24:28.009077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.008968    2554 scope.go:117] "RemoveContainer" containerID="b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"
Sep 15 20:24:28.018868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.018840    2554 scope.go:117] "RemoveContainer" containerID="ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"
Sep 15 20:24:28.027648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.027625    2554 scope.go:117] "RemoveContainer" containerID="b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"
Sep 15 20:24:28.027935 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:24:28.027917    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903\": container with ID starting with b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903 not found: ID does not exist" containerID="b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"
Sep 15 20:24:28.028005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.027946    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903"} err="failed to get container status \"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903\": rpc error: code = NotFound desc = could not find container \"b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903\": container with ID starting with b2fb3806a406993b457e8d0408fc68323d89593ebaf9750b648842bf267a4903 not found: ID does not exist"
Sep 15 20:24:28.028005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.027966    2554 scope.go:117] "RemoveContainer" containerID="ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"
Sep 15 20:24:28.028266 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:24:28.028249    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81\": container with ID starting with ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81 not found: ID does not exist" containerID="ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"
Sep 15 20:24:28.028321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.028268    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81"} err="failed to get container status \"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81\": rpc error: code = NotFound desc = could not find container \"ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81\": container with ID starting with ae415248fcaa5e836ef30473b2513c333558e92b5da473a8bea504c9a80f5d81 not found: ID does not exist"
Sep 15 20:24:28.031403 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.031378    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:24:28.043152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:28.040643    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-30d5aa-openshift-default-75666d4666-9dwzk"]
Sep 15 20:24:29.452525 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452491    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:24:29.452922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452884    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:29.452922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452897    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:29.452922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452907    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.452922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452912    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.452922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452923    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.453128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452930    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.453128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.452998    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.453128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.453006    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" containerName="istio-proxy"
Sep 15 20:24:29.453128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.453014    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcbab37c-ee62-446d-8437-e5b7dfdd7830" containerName="istio-proxy"
Sep 15 20:24:29.457424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.457402    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.459825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.459802    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-5c37e0-dockercfg-jgs42\""
Sep 15 20:24:29.460025 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.460007    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-5c37e0\""
Sep 15 20:24:29.462199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.462174    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.462300 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.462215    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrgwj\" (UniqueName: \"kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.466375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.466346    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:24:29.486797 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.486753    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:24:29.490679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.490656    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.503843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.503809    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:24:29.562825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.562766    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.563020 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.562848    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.563020 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.562905    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6s5fg\" (UniqueName: \"kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.563020 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.562941    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrgwj\" (UniqueName: \"kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.563806 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.563779    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.574806 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.574646    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrgwj\" (UniqueName: \"kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj\") pod \"payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.664464 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.664423    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6s5fg\" (UniqueName: \"kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.664658 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.664532    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.665292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.665272    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.674575 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.674543    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6s5fg\" (UniqueName: \"kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg\") pod \"payload-processing-e2e-explicit-5c37e0-66989d457-98fxn\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") " pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:29.769284 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.769240    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:29.800923 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:29.800889    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:30.022458 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:30.022374    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ccf117cd-1021-4cf9-95a2-9d1ecec4f048" path="/var/lib/kubelet/pods/ccf117cd-1021-4cf9-95a2-9d1ecec4f048/volumes"
Sep 15 20:24:30.044810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:30.044776    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:24:30.047936 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:24:30.047908    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f43ff40_e7e7_458c_9342_cba6fa3a9ee4.slice/crio-f4d0e504eac67e6c3dac9a806194066a2673fd3642231cd74ced23e805057d53 WatchSource:0}: Error finding container f4d0e504eac67e6c3dac9a806194066a2673fd3642231cd74ced23e805057d53: Status 404 returned error can't find the container with id f4d0e504eac67e6c3dac9a806194066a2673fd3642231cd74ced23e805057d53
Sep 15 20:24:30.085403 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:30.085324    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:24:30.087806 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:24:30.087780    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b6d61c7_bff9_4a13_82b0_57adfd07c29e.slice/crio-0b0a9ed368943bf63f60b3147c2a80abc1a71eb9b9b96cda944e1d574cbc4263 WatchSource:0}: Error finding container 0b0a9ed368943bf63f60b3147c2a80abc1a71eb9b9b96cda944e1d574cbc4263: Status 404 returned error can't find the container with id 0b0a9ed368943bf63f60b3147c2a80abc1a71eb9b9b96cda944e1d574cbc4263
Sep 15 20:24:31.026517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.026479    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" event={"ID":"9b6d61c7-bff9-4a13-82b0-57adfd07c29e","Type":"ContainerStarted","Data":"07fdf63257bcf235c79f15063a4a3ce7d225de12a40092eb30a291b6743e5fc3"}
Sep 15 20:24:31.027034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.026546    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" event={"ID":"9b6d61c7-bff9-4a13-82b0-57adfd07c29e","Type":"ContainerStarted","Data":"0b0a9ed368943bf63f60b3147c2a80abc1a71eb9b9b96cda944e1d574cbc4263"}
Sep 15 20:24:31.027034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.026685    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:31.028105 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.028077    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" event={"ID":"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4","Type":"ContainerStarted","Data":"c57e1999a8b8e0b3bd9fd9b6d7b026052827c1e657a99d4d90081a42da74ef16"}
Sep 15 20:24:31.028208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.028122    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" event={"ID":"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4","Type":"ContainerStarted","Data":"f4d0e504eac67e6c3dac9a806194066a2673fd3642231cd74ced23e805057d53"}
Sep 15 20:24:31.028208 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.028152    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:31.045308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.045251    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" podStartSLOduration=2.045235327 podStartE2EDuration="2.045235327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:24:31.0430368 +0000 UTC m=+1165.487995809" watchObservedRunningTime="2026-09-15 20:24:31.045235327 +0000 UTC m=+1165.490194335"
Sep 15 20:24:31.058694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:31.058634    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" podStartSLOduration=2.058617563 podStartE2EDuration="2.058617563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:24:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:24:31.057938914 +0000 UTC m=+1165.502897935" watchObservedRunningTime="2026-09-15 20:24:31.058617563 +0000 UTC m=+1165.503576571"
Sep 15 20:24:39.134439 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:39.134398    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:24:42.035195 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:42.035158    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:24:42.035701 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:42.035246    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:24:47.732083 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.732043    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:24:47.735311 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.735290    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.738779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.738753    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7e3543\"/\"kube-root-ca.crt\""
Sep 15 20:24:47.738916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.738777    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7e3543\"/\"premium-w0-7e3543-kserve-self-signed-certs\""
Sep 15 20:24:47.738916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.738777    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7e3543\"/\"default-dockercfg-6p8m2\""
Sep 15 20:24:47.738916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.738753    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-7e3543\"/\"openshift-service-ca.crt\""
Sep 15 20:24:47.746611 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.746586    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:24:47.842651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842614    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.842868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842676    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.842868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.842868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842785    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.842868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842806    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5zp7\" (UniqueName: \"kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.842868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.842827    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.943816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943771    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943827    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943850    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943896    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943926    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5zp7\" (UniqueName: \"kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.943955    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.944332    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.944351    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.944478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.944408    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.946170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.946146    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.946375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.946359    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:47.954508 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:47.954481    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5zp7\" (UniqueName: \"kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7\") pod \"premium-w0-7e3543-kserve-74d5546bbc-5kr2r\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") " pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:48.046718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:48.046628    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:48.324479 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:48.324450    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:24:48.326812 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:24:48.326779    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27800a24_96b4_4289_b141_93b27bf5cf0b.slice/crio-5590dc53a6af855100d86621880f44ad00e2f0d53234119e8a35ab788b48a3e8 WatchSource:0}: Error finding container 5590dc53a6af855100d86621880f44ad00e2f0d53234119e8a35ab788b48a3e8: Status 404 returned error can't find the container with id 5590dc53a6af855100d86621880f44ad00e2f0d53234119e8a35ab788b48a3e8
Sep 15 20:24:49.119004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:49.118954    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" event={"ID":"27800a24-96b4-4289-b141-93b27bf5cf0b","Type":"ContainerStarted","Data":"03f2549d3734cd485cb6fa93b63af75404b98ac342d1de86b068d1f5ac021245"}
Sep 15 20:24:49.121240 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:49.119016    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" event={"ID":"27800a24-96b4-4289-b141-93b27bf5cf0b","Type":"ContainerStarted","Data":"5590dc53a6af855100d86621880f44ad00e2f0d53234119e8a35ab788b48a3e8"}
Sep 15 20:24:49.136653 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:49.136594    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" podStartSLOduration=2.136572418 podStartE2EDuration="2.136572418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:24:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:24:49.135058928 +0000 UTC m=+1183.580017937" watchObservedRunningTime="2026-09-15 20:24:49.136572418 +0000 UTC m=+1183.581531426"
Sep 15 20:24:50.125766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.125729    2554 generic.go:356] "Generic (PLEG): container finished" podID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerID="3c242a80401b3172c64515b02ac0b6f70b147fa3e6645d1cfc38c6d650a0151e" exitCode=0
Sep 15 20:24:50.126233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.125804    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerDied","Data":"3c242a80401b3172c64515b02ac0b6f70b147fa3e6645d1cfc38c6d650a0151e"}
Sep 15 20:24:50.126233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.126205    2554 scope.go:117] "RemoveContainer" containerID="3c242a80401b3172c64515b02ac0b6f70b147fa3e6645d1cfc38c6d650a0151e"
Sep 15 20:24:50.129181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.128512    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:50.129181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.128679    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:50.129181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:50.128778    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:24:51.137090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:51.136086    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerStarted","Data":"a93fa0d4337fbf40d5bf6a449195c2f0403c74aaa42b0a62fe15b8be1b5c1bfb"}
Sep 15 20:24:51.359084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:51.359038    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:51.360568 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:51.360535    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:51.360698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:51.360621    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:52.358567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:52.358534    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:52.358972 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:52.358591    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:53.359112 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:53.359068    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:53.359535 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:53.359147    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:54.359343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:54.359298    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:54.359828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:54.359381    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:54.841633 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:54.841573    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:24:54.993729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:54.993679    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:55.359791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:55.359749    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:55.360219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:55.359826    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:56.359656 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:56.359614    2554 patch_prober.go:28] interesting pod/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 20:24:56.359828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:56.359687    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 20:24:57.363537 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:57.363503    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:57.364534 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:57.364510    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:24:58.047059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:58.047008    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:58.047059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:58.047064    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:58.059786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:58.059750    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:24:58.190893 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:24:58.190862    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:25:16.939698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:16.939662    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:25:29.586249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.586212    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:25:29.590955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.590928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.593761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.593738    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-dad434fa-openshift-default-dockercfg-wbqb8\""
Sep 15 20:25:29.608523 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.608491    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:25:29.645106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645066    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645110    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645134    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645160    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645189    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645216    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645344    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645373    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbtjq\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.645549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.645416    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746189 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746150    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746407 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746212    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746407 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746323    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbtjq\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746407    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746460    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746499    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746527    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746600    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746636    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.746794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.746787    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.747037 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.747011    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.747037 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.747020    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.747324 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.747295    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.748886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.748861    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.749263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.749240    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.754932 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.754906    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.755051 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.754969    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbtjq\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq\") pod \"e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") " pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:29.901408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:29.901302    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:30.224249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.224211    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:25:30.227683 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:25:30.227658    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a0a21d4_ad2c_43f2_97b9_342c762c3c16.slice/crio-a5b370b378cabae10ac43503d1850266d67c603e33a3c19bb48d48de8bc814f5 WatchSource:0}: Error finding container a5b370b378cabae10ac43503d1850266d67c603e33a3c19bb48d48de8bc814f5: Status 404 returned error can't find the container with id a5b370b378cabae10ac43503d1850266d67c603e33a3c19bb48d48de8bc814f5
Sep 15 20:25:30.230136 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.230102    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:25:30.230226 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.230172    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:25:30.230226 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.230200    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:25:30.343258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.343215    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerStarted","Data":"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"}
Sep 15 20:25:30.343461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.343322    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerStarted","Data":"a5b370b378cabae10ac43503d1850266d67c603e33a3c19bb48d48de8bc814f5"}
Sep 15 20:25:30.394385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.394321    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podStartSLOduration=1.394300389 podStartE2EDuration="1.394300389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:25:30.393055906 +0000 UTC m=+1224.838014916" watchObservedRunningTime="2026-09-15 20:25:30.394300389 +0000 UTC m=+1224.839259398"
Sep 15 20:25:30.902514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:30.902473    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:31.907353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:31.907322    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:32.353925 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:32.353892    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:32.355003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:32.354962    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:25:40.716724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.716682    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:25:40.720649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.720620    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.723602 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.723580    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-dad434fa-dockercfg-mfql7\""
Sep 15 20:25:40.723774 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.723615    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-dad434fa\""
Sep 15 20:25:40.729612 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.729589    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:25:40.854379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.854340    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.854550 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.854444    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2mfd\" (UniqueName: \"kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.955999 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.955944    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.956217 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.956061    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2mfd\" (UniqueName: \"kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.956681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.956657    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:40.964589 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:40.964557    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2mfd\" (UniqueName: \"kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd\") pod \"payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") " pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:41.032696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.032602    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:41.306858 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.306832    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:25:41.309372 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:25:41.309336    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8bd9676_5fa7_4cf1_9ecd_0897a9decab7.slice/crio-8ecb73a20cce8280b208f27543bcfba199098d6b1eb33aa45b8dfeadff6b57e2 WatchSource:0}: Error finding container 8ecb73a20cce8280b208f27543bcfba199098d6b1eb33aa45b8dfeadff6b57e2: Status 404 returned error can't find the container with id 8ecb73a20cce8280b208f27543bcfba199098d6b1eb33aa45b8dfeadff6b57e2
Sep 15 20:25:41.401863 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.401830    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" event={"ID":"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7","Type":"ContainerStarted","Data":"c5d7b273a8a61f79735fe254c9bbf84343af8bf45b9947118a9aa3978472a7e1"}
Sep 15 20:25:41.402061 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.401885    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" event={"ID":"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7","Type":"ContainerStarted","Data":"8ecb73a20cce8280b208f27543bcfba199098d6b1eb33aa45b8dfeadff6b57e2"}
Sep 15 20:25:41.402061 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.401919    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:25:41.421656 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:41.421593    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" podStartSLOduration=1.421567241 podStartE2EDuration="1.421567241s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:25:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:25:41.420251671 +0000 UTC m=+1235.865210680" watchObservedRunningTime="2026-09-15 20:25:41.421567241 +0000 UTC m=+1235.866526251"
Sep 15 20:25:50.448219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:50.448181    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:25:52.409701 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:25:52.409665    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:26:01.504276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.504194    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerID="a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777" exitCode=0
Sep 15 20:26:01.504276 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.504263    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerDied","Data":"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"}
Sep 15 20:26:01.504708 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.504687    2554 scope.go:117] "RemoveContainer" containerID="a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"
Sep 15 20:26:01.505954 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.505923    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:01.506042 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.506027    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:01.506084 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:01.506066    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:02.354324 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:02.354282    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:02.511541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:02.511509    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerStarted","Data":"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"}
Sep 15 20:26:02.901565 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:02.901534    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:02.902581 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:02.902555    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:02.902691 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:02.902604    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:03.902776 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:03.902737    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:03.903239 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:03.902802    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:04.901934 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:04.901890    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:04.902157 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:04.901956    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:05.901882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:05.901848    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:05.902286 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:05.901899    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:06.902280 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:06.902228    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:06.902769 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:06.902303    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:07.902177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:07.902142    2554 patch_prober.go:28] interesting pod/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused" start-of-body=
Sep 15 20:26:07.902360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:07.902199    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.51:15021/healthz/ready\": dial tcp 10.134.0.51:15021: connect: connection refused"
Sep 15 20:26:08.905823 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:08.905792    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:08.906235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:08.906132    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:08.906948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:08.906928    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:13.584895 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.584857    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"]
Sep 15 20:26:13.588160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.588141    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:13.590576 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.590552    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:26:13.590694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.590556    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:26:13.597621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.597594    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"]
Sep 15 20:26:13.681690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.681650    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8\" (UID: \"99eda4c1-9865-4ce7-a1c4-1a534bc0800e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:13.782404 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.782367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8\" (UID: \"99eda4c1-9865-4ce7-a1c4-1a534bc0800e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:13.782974 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.782954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8\" (UID: \"99eda4c1-9865-4ce7-a1c4-1a534bc0800e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:13.899532 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:13.899434    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:14.171220 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:14.171194    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"]
Sep 15 20:26:14.173135 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:26:14.173106    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99eda4c1_9865_4ce7_a1c4_1a534bc0800e.slice/crio-485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986 WatchSource:0}: Error finding container 485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986: Status 404 returned error can't find the container with id 485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986
Sep 15 20:26:14.582918 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:14.582878    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8" event={"ID":"99eda4c1-9865-4ce7-a1c4-1a534bc0800e","Type":"ContainerStarted","Data":"88b8de91e3e26c240c5428deef71a332457547436587c68d3cf8e20f3a3928ab"}
Sep 15 20:26:14.583138 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:14.582940    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8" event={"ID":"99eda4c1-9865-4ce7-a1c4-1a534bc0800e","Type":"ContainerStarted","Data":"485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986"}
Sep 15 20:26:14.598640 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:14.598580    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8" podStartSLOduration=1.5985627550000001 podStartE2EDuration="1.598562755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:26:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:26:14.597251358 +0000 UTC m=+1269.042210368" watchObservedRunningTime="2026-09-15 20:26:14.598562755 +0000 UTC m=+1269.043521765"
Sep 15 20:26:15.589510 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:15.589469    2554 generic.go:356] "Generic (PLEG): container finished" podID="99eda4c1-9865-4ce7-a1c4-1a534bc0800e" containerID="88b8de91e3e26c240c5428deef71a332457547436587c68d3cf8e20f3a3928ab" exitCode=0
Sep 15 20:26:15.589723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:15.589559    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8" event={"ID":"99eda4c1-9865-4ce7-a1c4-1a534bc0800e","Type":"ContainerDied","Data":"88b8de91e3e26c240c5428deef71a332457547436587c68d3cf8e20f3a3928ab"}
Sep 15 20:26:16.731193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:16.731164    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:16.811117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:16.811081    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca\") pod \"99eda4c1-9865-4ce7-a1c4-1a534bc0800e\" (UID: \"99eda4c1-9865-4ce7-a1c4-1a534bc0800e\") "
Sep 15 20:26:16.811453 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:16.811429    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "99eda4c1-9865-4ce7-a1c4-1a534bc0800e" (UID: "99eda4c1-9865-4ce7-a1c4-1a534bc0800e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:16.912590 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:16.912508    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/99eda4c1-9865-4ce7-a1c4-1a534bc0800e-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:17.600348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:17.600308    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8" event={"ID":"99eda4c1-9865-4ce7-a1c4-1a534bc0800e","Type":"ContainerDied","Data":"485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986"}
Sep 15 20:26:17.600530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:17.600357    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="485beda02709ca46b9157b662bcebae017043af7ea1f2575b621bd48c482d986"
Sep 15 20:26:17.600530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:17.600317    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"
Sep 15 20:26:20.938720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:20.938681    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:26:23.555976 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.555939    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"]
Sep 15 20:26:23.556357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.556315    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="99eda4c1-9865-4ce7-a1c4-1a534bc0800e" containerName="revoke-keys"
Sep 15 20:26:23.556357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.556327    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="99eda4c1-9865-4ce7-a1c4-1a534bc0800e" containerName="revoke-keys"
Sep 15 20:26:23.556453 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.556390    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="99eda4c1-9865-4ce7-a1c4-1a534bc0800e" containerName="revoke-keys"
Sep 15 20:26:23.559494 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.559477    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:23.562584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.562557    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:26:23.562584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.562566    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:26:23.567118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.566807    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"]
Sep 15 20:26:23.688915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.688865    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8\" (UID: \"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:23.790406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.790367    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8\" (UID: \"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:23.791109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.791084    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8\" (UID: \"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:23.871401 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:23.871310    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:24.148008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.144882    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"]
Sep 15 20:26:24.152186 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:26:24.152142    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfd28a03_efca_4aea_8a8d_7ea94b11f2ff.slice/crio-02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079 WatchSource:0}: Error finding container 02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079: Status 404 returned error can't find the container with id 02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079
Sep 15 20:26:24.455649 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.455551    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:26:24.455831 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.455785    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" podUID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" containerName="payload-processing" containerID="cri-o://c5d7b273a8a61f79735fe254c9bbf84343af8bf45b9947118a9aa3978472a7e1" gracePeriod=30
Sep 15 20:26:24.638626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.638591    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8" event={"ID":"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff","Type":"ContainerStarted","Data":"f687b533737e8688d5a2f88c824d74bccb45181d14556d8f75e27bee35c4ca0e"}
Sep 15 20:26:24.639056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.638647    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8" event={"ID":"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff","Type":"ContainerStarted","Data":"02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079"}
Sep 15 20:26:24.640268 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.640247    2554 generic.go:356] "Generic (PLEG): container finished" podID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" containerID="c5d7b273a8a61f79735fe254c9bbf84343af8bf45b9947118a9aa3978472a7e1" exitCode=0
Sep 15 20:26:24.640370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.640322    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" event={"ID":"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7","Type":"ContainerDied","Data":"c5d7b273a8a61f79735fe254c9bbf84343af8bf45b9947118a9aa3978472a7e1"}
Sep 15 20:26:24.667602 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.667551    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8" podStartSLOduration=1.6675352270000001 podStartE2EDuration="1.667535227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:26:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:26:24.667283031 +0000 UTC m=+1279.112242040" watchObservedRunningTime="2026-09-15 20:26:24.667535227 +0000 UTC m=+1279.112494235"
Sep 15 20:26:24.710005 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.709713    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:26:24.798764 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.798720    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"]
Sep 15 20:26:24.802488 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.802457    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-dad434fa-wjzs8"]
Sep 15 20:26:24.902074 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.902040    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume\") pod \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") "
Sep 15 20:26:24.902246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.902141    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2mfd\" (UniqueName: \"kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd\") pod \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\" (UID: \"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7\") "
Sep 15 20:26:24.902434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.902411    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" (UID: "e8bd9676-5fa7-4cf1-9ecd-0897a9decab7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:24.904275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:24.904255    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd" (OuterVolumeSpecName: "kube-api-access-g2mfd") pod "e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" (UID: "e8bd9676-5fa7-4cf1-9ecd-0897a9decab7"). InnerVolumeSpecName "kube-api-access-g2mfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:26:25.003385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.003296    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2mfd\" (UniqueName: \"kubernetes.io/projected/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-kube-api-access-g2mfd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:25.003385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.003322    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:25.646950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.646910    2554 generic.go:356] "Generic (PLEG): container finished" podID="cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" containerID="f687b533737e8688d5a2f88c824d74bccb45181d14556d8f75e27bee35c4ca0e" exitCode=0
Sep 15 20:26:25.647359 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.647020    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8" event={"ID":"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff","Type":"ContainerDied","Data":"f687b533737e8688d5a2f88c824d74bccb45181d14556d8f75e27bee35c4ca0e"}
Sep 15 20:26:25.648353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.648334    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"
Sep 15 20:26:25.648409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.648381    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v" event={"ID":"e8bd9676-5fa7-4cf1-9ecd-0897a9decab7","Type":"ContainerDied","Data":"8ecb73a20cce8280b208f27543bcfba199098d6b1eb33aa45b8dfeadff6b57e2"}
Sep 15 20:26:25.648454 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.648431    2554 scope.go:117] "RemoveContainer" containerID="c5d7b273a8a61f79735fe254c9bbf84343af8bf45b9947118a9aa3978472a7e1"
Sep 15 20:26:25.677002 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.676954    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:26:25.681145 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:25.681119    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-dad434fa-5f7d74c749-5lj2v"]
Sep 15 20:26:26.027790 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.027749    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="99eda4c1-9865-4ce7-a1c4-1a534bc0800e" path="/var/lib/kubelet/pods/99eda4c1-9865-4ce7-a1c4-1a534bc0800e/volumes"
Sep 15 20:26:26.028311 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.028293    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" path="/var/lib/kubelet/pods/e8bd9676-5fa7-4cf1-9ecd-0897a9decab7/volumes"
Sep 15 20:26:26.789423 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.789395    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:26.819197 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.819164    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca\") pod \"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff\" (UID: \"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff\") "
Sep 15 20:26:26.819503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.819478    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" (UID: "cfd28a03-efca-4aea-8a8d-7ea94b11f2ff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:26.920617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:26.920510    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:27.661905 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:27.661874    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"
Sep 15 20:26:27.662104 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:27.661906    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8" event={"ID":"cfd28a03-efca-4aea-8a8d-7ea94b11f2ff","Type":"ContainerDied","Data":"02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079"}
Sep 15 20:26:27.662104 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:27.661954    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02ce8c1b54c08b805f67bf40888f85f977d9609634b27910355770a399b31079"
Sep 15 20:26:31.079564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:31.079529    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:26:31.080032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:31.079838    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy" containerID="cri-o://48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a" gracePeriod=30
Sep 15 20:26:34.418970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.418936    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:26:34.419567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.419182    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" podUID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" containerName="payload-processing" containerID="cri-o://07fdf63257bcf235c79f15063a4a3ce7d225de12a40092eb30a291b6743e5fc3" gracePeriod=30
Sep 15 20:26:34.424971 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.424941    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:26:34.425242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.425189    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" podUID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" containerName="payload-pre-processing" containerID="cri-o://c57e1999a8b8e0b3bd9fd9b6d7b026052827c1e657a99d4d90081a42da74ef16" gracePeriod=30
Sep 15 20:26:34.587574 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.587530    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"]
Sep 15 20:26:34.591847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.591780    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-5c37e0-d8xk8"]
Sep 15 20:26:34.711502 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.711094    2554 generic.go:356] "Generic (PLEG): container finished" podID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" containerID="c57e1999a8b8e0b3bd9fd9b6d7b026052827c1e657a99d4d90081a42da74ef16" exitCode=0
Sep 15 20:26:34.711502 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.711271    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" event={"ID":"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4","Type":"ContainerDied","Data":"c57e1999a8b8e0b3bd9fd9b6d7b026052827c1e657a99d4d90081a42da74ef16"}
Sep 15 20:26:34.713107 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.713077    2554 generic.go:356] "Generic (PLEG): container finished" podID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" containerID="07fdf63257bcf235c79f15063a4a3ce7d225de12a40092eb30a291b6743e5fc3" exitCode=0
Sep 15 20:26:34.713234 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.713158    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" event={"ID":"9b6d61c7-bff9-4a13-82b0-57adfd07c29e","Type":"ContainerDied","Data":"07fdf63257bcf235c79f15063a4a3ce7d225de12a40092eb30a291b6743e5fc3"}
Sep 15 20:26:34.734775 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.734746    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:26:34.738134 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.738110    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:26:34.793222 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793191    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6s5fg\" (UniqueName: \"kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg\") pod \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") "
Sep 15 20:26:34.793418 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume\") pod \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") "
Sep 15 20:26:34.793418 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793262    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zrgwj\" (UniqueName: \"kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj\") pod \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\" (UID: \"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4\") "
Sep 15 20:26:34.793418 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793307    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume\") pod \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\" (UID: \"9b6d61c7-bff9-4a13-82b0-57adfd07c29e\") "
Sep 15 20:26:34.793759 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9b6d61c7-bff9-4a13-82b0-57adfd07c29e" (UID: "9b6d61c7-bff9-4a13-82b0-57adfd07c29e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:34.793840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.793755    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" (UID: "9f43ff40-e7e7-458c-9342-cba6fa3a9ee4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:34.795545 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.795524    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj" (OuterVolumeSpecName: "kube-api-access-zrgwj") pod "9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" (UID: "9f43ff40-e7e7-458c-9342-cba6fa3a9ee4"). InnerVolumeSpecName "kube-api-access-zrgwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:26:34.795593 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.795538    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg" (OuterVolumeSpecName: "kube-api-access-6s5fg") pod "9b6d61c7-bff9-4a13-82b0-57adfd07c29e" (UID: "9b6d61c7-bff9-4a13-82b0-57adfd07c29e"). InnerVolumeSpecName "kube-api-access-6s5fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:26:34.894748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.894708    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6s5fg\" (UniqueName: \"kubernetes.io/projected/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-kube-api-access-6s5fg\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:34.894748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.894742    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:34.894748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.894755    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zrgwj\" (UniqueName: \"kubernetes.io/projected/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4-kube-api-access-zrgwj\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:34.895008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:34.894767    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9b6d61c7-bff9-4a13-82b0-57adfd07c29e-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:35.720395 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.720363    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"
Sep 15 20:26:35.720867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.720359    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp" event={"ID":"9f43ff40-e7e7-458c-9342-cba6fa3a9ee4","Type":"ContainerDied","Data":"f4d0e504eac67e6c3dac9a806194066a2673fd3642231cd74ced23e805057d53"}
Sep 15 20:26:35.720867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.720515    2554 scope.go:117] "RemoveContainer" containerID="c57e1999a8b8e0b3bd9fd9b6d7b026052827c1e657a99d4d90081a42da74ef16"
Sep 15 20:26:35.722095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.721862    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn" event={"ID":"9b6d61c7-bff9-4a13-82b0-57adfd07c29e","Type":"ContainerDied","Data":"0b0a9ed368943bf63f60b3147c2a80abc1a71eb9b9b96cda944e1d574cbc4263"}
Sep 15 20:26:35.722095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.721906    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"
Sep 15 20:26:35.730022 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.729956    2554 scope.go:117] "RemoveContainer" containerID="07fdf63257bcf235c79f15063a4a3ce7d225de12a40092eb30a291b6743e5fc3"
Sep 15 20:26:35.745231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.745204    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:26:35.749918 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.749895    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-5c37e0-7c45bbc4b-hg8mp"]
Sep 15 20:26:35.761210 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.761170    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:26:35.763650 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:35.763626    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-5c37e0-66989d457-98fxn"]
Sep 15 20:26:36.025610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.025521    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" path="/var/lib/kubelet/pods/9b6d61c7-bff9-4a13-82b0-57adfd07c29e/volumes"
Sep 15 20:26:36.026071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.026056    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" path="/var/lib/kubelet/pods/9f43ff40-e7e7-458c-9342-cba6fa3a9ee4/volumes"
Sep 15 20:26:36.026496 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.026482    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" path="/var/lib/kubelet/pods/cfd28a03-efca-4aea-8a8d-7ea94b11f2ff/volumes"
Sep 15 20:26:36.336036 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.336011    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:36.410919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.410888    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.410944    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.410969    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411032    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411057    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411081    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hbtjq\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411255    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411315    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411338    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:26:36.411465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411357    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:26:36.411465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411366    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token\") pod \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\" (UID: \"7a0a21d4-ad2c-43f2-97b9-342c762c3c16\") "
Sep 15 20:26:36.411724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411487    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:26:36.411724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411508    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:26:36.411724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411608    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data" (OuterVolumeSpecName: "istio-data") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:26:36.411890 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411871    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.411948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411896    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.411948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411910    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.411948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411923    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.411948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.411935    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.413220 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.413199    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq" (OuterVolumeSpecName: "kube-api-access-hbtjq") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "kube-api-access-hbtjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:26:36.413323 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.413223    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:26:36.413676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.413658    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token" (OuterVolumeSpecName: "istio-token") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:26:36.413676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.413661    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7a0a21d4-ad2c-43f2-97b9-342c762c3c16" (UID: "7a0a21d4-ad2c-43f2-97b9-342c762c3c16"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:26:36.513473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.513436    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hbtjq\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-kube-api-access-hbtjq\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.513473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.513467    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.513473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.513476    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.513473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.513484    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7a0a21d4-ad2c-43f2-97b9-342c762c3c16-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:26:36.728924 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.728885    2554 generic.go:356] "Generic (PLEG): container finished" podID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerID="48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a" exitCode=0
Sep 15 20:26:36.729399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.728939    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"
Sep 15 20:26:36.729399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.728967    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerDied","Data":"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"}
Sep 15 20:26:36.729399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.729051    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r" event={"ID":"7a0a21d4-ad2c-43f2-97b9-342c762c3c16","Type":"ContainerDied","Data":"a5b370b378cabae10ac43503d1850266d67c603e33a3c19bb48d48de8bc814f5"}
Sep 15 20:26:36.729399 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.729081    2554 scope.go:117] "RemoveContainer" containerID="48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"
Sep 15 20:26:36.738748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.738728    2554 scope.go:117] "RemoveContainer" containerID="a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"
Sep 15 20:26:36.748447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.748325    2554 scope.go:117] "RemoveContainer" containerID="48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"
Sep 15 20:26:36.748725 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:26:36.748698    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a\": container with ID starting with 48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a not found: ID does not exist" containerID="48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"
Sep 15 20:26:36.748813 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.748737    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a"} err="failed to get container status \"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a\": rpc error: code = NotFound desc = could not find container \"48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a\": container with ID starting with 48472ef8012b20c237682a9da1aeb613914e4b7823d77859a68cae764e9f019a not found: ID does not exist"
Sep 15 20:26:36.748813 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.748764    2554 scope.go:117] "RemoveContainer" containerID="a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"
Sep 15 20:26:36.749122 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:26:36.749096    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777\": container with ID starting with a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777 not found: ID does not exist" containerID="a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"
Sep 15 20:26:36.749228 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.749133    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777"} err="failed to get container status \"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777\": rpc error: code = NotFound desc = could not find container \"a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777\": container with ID starting with a1d2fe6e81c431c569f72c637c1bba55f8e77e96df0e742672355cfaefe6f777 not found: ID does not exist"
Sep 15 20:26:36.750412 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.750388    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:26:36.760158 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:36.760125    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-dad434fa-openshift-default-767887fc64-d6d9r"]
Sep 15 20:26:38.026811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:38.026763    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" path="/var/lib/kubelet/pods/7a0a21d4-ad2c-43f2-97b9-342c762c3c16/volumes"
Sep 15 20:26:44.996586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.996546    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:26:44.997188 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997166    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997190    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997209    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" containerName="payload-pre-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997217    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" containerName="payload-pre-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997230    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" containerName="payload-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997238    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" containerName="payload-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997253    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" containerName="payload-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997262    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" containerName="payload-processing"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997280    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997292 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997288    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997304    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" containerName="revoke-keys"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997312    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" containerName="revoke-keys"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997397    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997408    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b6d61c7-bff9-4a13-82b0-57adfd07c29e" containerName="payload-processing"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997420    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a0a21d4-ad2c-43f2-97b9-342c762c3c16" containerName="istio-proxy"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997430    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8bd9676-5fa7-4cf1-9ecd-0897a9decab7" containerName="payload-processing"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997439    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f43ff40-e7e7-458c-9342-cba6fa3a9ee4" containerName="payload-pre-processing"
Sep 15 20:26:44.997729 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:44.997448    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfd28a03-efca-4aea-8a8d-7ea94b11f2ff" containerName="revoke-keys"
Sep 15 20:26:45.002325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.002298    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.005251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.005231    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-dc12d7-openshift-default-dockercfg-6d5mh\""
Sep 15 20:26:45.013779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.013750    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:26:45.098784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.098741    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099076 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099052    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099274 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099246    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099405 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099321    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8j94\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099405 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099371    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099426    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099458    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.099697 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.099525    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200683    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200716    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200742    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8j94\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200774    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.200824 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200806    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201145 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200836    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201145 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200872    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201145 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.200896    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201145 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.201096    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201365 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.201164    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201365 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.201353    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.201377    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.201604 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.201582    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.203271 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.203249    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.203474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.203456    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.208926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.208902    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.209230 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.209211    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8j94\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94\") pod \"e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") " pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.313177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.313069    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:45.594624 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.594598    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:26:45.597118 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:26:45.597082    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bfccabb_d5da_4e7d_a77f_102141d70592.slice/crio-d896c7041a797376854b57d608676ac564da7eef07c43ecb006765e54b466e80 WatchSource:0}: Error finding container d896c7041a797376854b57d608676ac564da7eef07c43ecb006765e54b466e80: Status 404 returned error can't find the container with id d896c7041a797376854b57d608676ac564da7eef07c43ecb006765e54b466e80
Sep 15 20:26:45.599510 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.599473    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:45.599617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.599545    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:45.599617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.599578    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:26:45.789992 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.789942    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerStarted","Data":"6e19c40475082cf02e4b84d902aa0a3a7f58cde561f009b2257ef8adc0cdba5c"}
Sep 15 20:26:45.790182 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.790025    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerStarted","Data":"d896c7041a797376854b57d608676ac564da7eef07c43ecb006765e54b466e80"}
Sep 15 20:26:45.811419 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:45.811363    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podStartSLOduration=1.811346911 podStartE2EDuration="1.811346911s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:26:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:26:45.810055881 +0000 UTC m=+1300.255014889" watchObservedRunningTime="2026-09-15 20:26:45.811346911 +0000 UTC m=+1300.256305919"
Sep 15 20:26:46.313260 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:46.313231    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:46.318305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:46.318278    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:46.795629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:46.795597    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:46.796624 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:46.796604    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:26:51.905998 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.905941    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:26:51.909689 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.909663    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:51.912361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.912334    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-dc12d7\""
Sep 15 20:26:51.921346 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.921317    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:26:51.958351 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.958313    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:26:51.961751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.961733    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:51.965491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.965461    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-dc12d7-dockercfg-8q7m5\""
Sep 15 20:26:51.970730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.970702    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:51.970861 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.970824    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtq77\" (UniqueName: \"kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:51.976196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:51.976168    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:26:52.072339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.072296    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfc9x\" (UniqueName: \"kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.072543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.072387    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.072543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.072477    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.072543 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.072538    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtq77\" (UniqueName: \"kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.073854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.073801    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.087669 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.087640    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtq77\" (UniqueName: \"kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77\") pod \"payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.173554 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.173453    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfc9x\" (UniqueName: \"kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.173714 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.173565    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.174308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.174286    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.182501 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.182479    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfc9x\" (UniqueName: \"kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x\") pod \"payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.221646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.221605    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.272245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.272183    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.498594 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.498570    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:26:52.501334 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:26:52.501306    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc1d2be_b75e_409f_8266_59d4465bcc12.slice/crio-0e509ebce360f6544abd1a834a9592c6b6dcf02a4f6dfe87ea8b5a92214f50db WatchSource:0}: Error finding container 0e509ebce360f6544abd1a834a9592c6b6dcf02a4f6dfe87ea8b5a92214f50db: Status 404 returned error can't find the container with id 0e509ebce360f6544abd1a834a9592c6b6dcf02a4f6dfe87ea8b5a92214f50db
Sep 15 20:26:52.571762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.571734    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:26:52.574168 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:26:52.574140    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod087fe3b8_96f2_4978_ab27_937574b0808d.slice/crio-33512182571cedaece2cd63072639136829f45a9c409b0568c3dd50425b2ac86 WatchSource:0}: Error finding container 33512182571cedaece2cd63072639136829f45a9c409b0568c3dd50425b2ac86: Status 404 returned error can't find the container with id 33512182571cedaece2cd63072639136829f45a9c409b0568c3dd50425b2ac86
Sep 15 20:26:52.826457 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.826364    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" event={"ID":"bcc1d2be-b75e-409f-8266-59d4465bcc12","Type":"ContainerStarted","Data":"eaf1eb2e7feca395710cc8bdf37b95ae2f96ac4148d2d164f4d48a1a0d8d4732"}
Sep 15 20:26:52.826457 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.826423    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" event={"ID":"bcc1d2be-b75e-409f-8266-59d4465bcc12","Type":"ContainerStarted","Data":"0e509ebce360f6544abd1a834a9592c6b6dcf02a4f6dfe87ea8b5a92214f50db"}
Sep 15 20:26:52.826703 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.826474    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:26:52.828180 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.828156    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" event={"ID":"087fe3b8-96f2-4978-ab27-937574b0808d","Type":"ContainerStarted","Data":"6c3234f7c632c47358ead67ceb5cea495d658606a73638b169cd01eeaf23fe6f"}
Sep 15 20:26:52.828290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.828193    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" event={"ID":"087fe3b8-96f2-4978-ab27-937574b0808d","Type":"ContainerStarted","Data":"33512182571cedaece2cd63072639136829f45a9c409b0568c3dd50425b2ac86"}
Sep 15 20:26:52.828335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.828298    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:26:52.844123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.844060    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" podStartSLOduration=1.8440371469999999 podStartE2EDuration="1.844037147s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:26:52.841815352 +0000 UTC m=+1307.286774363" watchObservedRunningTime="2026-09-15 20:26:52.844037147 +0000 UTC m=+1307.288996158"
Sep 15 20:26:52.859213 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:52.859148    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" podStartSLOduration=1.859128826 podStartE2EDuration="1.859128826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:26:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:26:52.857448554 +0000 UTC m=+1307.302407565" watchObservedRunningTime="2026-09-15 20:26:52.859128826 +0000 UTC m=+1307.304087834"
Sep 15 20:26:53.938428 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:26:53.938386    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:27:03.835845 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:03.835813    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:27:03.836250 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:03.836006    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:27:12.332513 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:12.332473    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:27:13.941977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.941946    2554 generic.go:356] "Generic (PLEG): container finished" podID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerID="6e19c40475082cf02e4b84d902aa0a3a7f58cde561f009b2257ef8adc0cdba5c" exitCode=0
Sep 15 20:27:13.941977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.942005    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerDied","Data":"6e19c40475082cf02e4b84d902aa0a3a7f58cde561f009b2257ef8adc0cdba5c"}
Sep 15 20:27:13.942467 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.942426    2554 scope.go:117] "RemoveContainer" containerID="6e19c40475082cf02e4b84d902aa0a3a7f58cde561f009b2257ef8adc0cdba5c"
Sep 15 20:27:13.943613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.943581    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:13.943694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.943655    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:13.943694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:13.943689    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:14.958254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:14.958217    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerStarted","Data":"6c145a916c51b381a75ca5a50e2db1b09b9cbbd656075b6781c5ceb1191554ca"}
Sep 15 20:27:15.313883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:15.313792    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:27:15.314800 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:15.314768    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 20:27:15.314946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:15.314824    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 20:27:16.313582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:16.313546    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 20:27:16.313975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:16.313605    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 20:27:16.796310 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:16.796274    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:27:17.313887 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:17.313846    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 20:27:17.314306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:17.313909    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 20:27:17.863304 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:17.863265    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:27:17.863576 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:17.863543    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy" containerID="cri-o://a93fa0d4337fbf40d5bf6a449195c2f0403c74aaa42b0a62fe15b8be1b5c1bfb" gracePeriod=30
Sep 15 20:27:18.313715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.313674    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 20:27:18.313908 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.313733    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 20:27:18.423876 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.423837    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:27:18.427761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.427739    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.430474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.430454    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-f49968-openshift-default-dockercfg-zmkcp\""
Sep 15 20:27:18.445003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.441505    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:27:18.526128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526094    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bq4cf\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526173    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526224    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526376    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526484    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526533    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526561    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526611    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.526726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.526696    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.627683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627592    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.627683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.627683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627654    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.627683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627679    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627702    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627754    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bq4cf\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627785    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627831    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.627878    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628352 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.628113    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628352 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.628192    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628352 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.628307    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628352 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.628333    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.628721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.628696    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.630209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.630184    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.630607 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.630558    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.645044 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.645014    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bq4cf\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.646515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.646488    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token\") pod \"e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") " pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:18.760583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:18.760277    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:19.081452 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.081426    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:27:19.083107 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:27:19.083078    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podedb47852_cb53_4faf_a34e_3ed5d9ac2ae0.slice/crio-ba52223f78c963670fc8cea8fa6de15a991995546e8e6264630915d00bd5bdd0 WatchSource:0}: Error finding container ba52223f78c963670fc8cea8fa6de15a991995546e8e6264630915d00bd5bdd0: Status 404 returned error can't find the container with id ba52223f78c963670fc8cea8fa6de15a991995546e8e6264630915d00bd5bdd0
Sep 15 20:27:19.085632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.085598    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:19.085717 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.085682    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:19.085717 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.085712    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:19.313926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.313887    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 20:27:19.314342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.313957    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 20:27:19.989623 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.989585    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerStarted","Data":"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"}
Sep 15 20:27:19.989826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:19.989643    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerStarted","Data":"ba52223f78c963670fc8cea8fa6de15a991995546e8e6264630915d00bd5bdd0"}
Sep 15 20:27:20.017473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:20.017403    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podStartSLOduration=2.017382977 podStartE2EDuration="2.017382977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:27:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:27:20.015205758 +0000 UTC m=+1334.460164791" watchObservedRunningTime="2026-09-15 20:27:20.017382977 +0000 UTC m=+1334.462341986"
Sep 15 20:27:20.318310 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:20.318223    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:27:20.319181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:20.319160    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:27:20.760972 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:20.760929    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:20.766317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:20.766289    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:21.001926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:21.001884    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:21.002726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:21.002705    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:23.014956 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.014915    2554 generic.go:356] "Generic (PLEG): container finished" podID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerID="a93fa0d4337fbf40d5bf6a449195c2f0403c74aaa42b0a62fe15b8be1b5c1bfb" exitCode=0
Sep 15 20:27:23.015441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.014953    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerDied","Data":"a93fa0d4337fbf40d5bf6a449195c2f0403c74aaa42b0a62fe15b8be1b5c1bfb"}
Sep 15 20:27:23.015441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.015055    2554 scope.go:117] "RemoveContainer" containerID="3c242a80401b3172c64515b02ac0b6f70b147fa3e6645d1cfc38c6d650a0151e"
Sep 15 20:27:23.122569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.122542    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:27:23.176001 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.175894    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176001 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.175935    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176001 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.175967    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176051    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176087    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176141    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176169    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176244    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176297 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176281    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tcl5b\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b\") pod \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\" (UID: \"07bd2806-2600-4a07-ad7d-0ae30ba35fe7\") "
Sep 15 20:27:23.176625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176300    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:27:23.176625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176501    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:27:23.176625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176606    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.176625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176624    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.176837 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176731    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data" (OuterVolumeSpecName: "istio-data") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:27:23.176919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176895    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:27:23.177004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.176968    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:27:23.178436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.178408    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:27:23.178436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.178408    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b" (OuterVolumeSpecName: "kube-api-access-tcl5b") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "kube-api-access-tcl5b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:27:23.178670 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.178653    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token" (OuterVolumeSpecName: "istio-token") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:27:23.178736 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.178690    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "07bd2806-2600-4a07-ad7d-0ae30ba35fe7" (UID: "07bd2806-2600-4a07-ad7d-0ae30ba35fe7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:27:23.277181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277138    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277173    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277182    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277190    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277198    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tcl5b\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-kube-api-access-tcl5b\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277208    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:23.277473 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:23.277216    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07bd2806-2600-4a07-ad7d-0ae30ba35fe7-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:27:24.021831 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:24.021802    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"
Sep 15 20:27:24.023316 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:24.023292    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2" event={"ID":"07bd2806-2600-4a07-ad7d-0ae30ba35fe7","Type":"ContainerDied","Data":"989d587b754a3d517f088ce0e41a983f01a04992d123c935cb4bf71fa1d2a75f"}
Sep 15 20:27:24.023393 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:24.023342    2554 scope.go:117] "RemoveContainer" containerID="a93fa0d4337fbf40d5bf6a449195c2f0403c74aaa42b0a62fe15b8be1b5c1bfb"
Sep 15 20:27:24.050860 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:24.050826    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:27:24.058596 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:24.058566    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-5c37e0-openshift-default-6966656b6d-m9qg2"]
Sep 15 20:27:26.025420 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:26.025377    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" path="/var/lib/kubelet/pods/07bd2806-2600-4a07-ad7d-0ae30ba35fe7/volumes"
Sep 15 20:27:27.132214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132180    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:27:27.132600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132564    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:27.132600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132579    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:27.132600 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132600    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:27.132709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132607    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:27.132709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.132673    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:27.137171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.137148    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.139795 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.139771    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f49968\""
Sep 15 20:27:27.139907 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.139864    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f49968-dockercfg-zbz9s\""
Sep 15 20:27:27.147078 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.147046    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:27:27.218679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.218640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csx8k\" (UniqueName: \"kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.218830 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.218720    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.319544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.319500    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csx8k\" (UniqueName: \"kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.319740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.319557    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.320317 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.320296    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.327846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.327824    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csx8k\" (UniqueName: \"kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k\") pod \"payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.449349 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.449259    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:27.723384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:27.723358    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:27:27.725581 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:27:27.725557    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973171a0_81c5_4b9d_a246_165678e76076.slice/crio-c3754aa558daed22ec2d227aedb479299a825115c20aa586705bd85d0967c004 WatchSource:0}: Error finding container c3754aa558daed22ec2d227aedb479299a825115c20aa586705bd85d0967c004: Status 404 returned error can't find the container with id c3754aa558daed22ec2d227aedb479299a825115c20aa586705bd85d0967c004
Sep 15 20:27:28.047771 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:28.047668    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" event={"ID":"973171a0-81c5-4b9d-a246-165678e76076","Type":"ContainerStarted","Data":"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"}
Sep 15 20:27:28.047771 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:28.047728    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" event={"ID":"973171a0-81c5-4b9d-a246-165678e76076","Type":"ContainerStarted","Data":"c3754aa558daed22ec2d227aedb479299a825115c20aa586705bd85d0967c004"}
Sep 15 20:27:28.047771 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:28.047757    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:28.073308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:28.073247    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" podStartSLOduration=1.073223111 podStartE2EDuration="1.073223111s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:27:28.073143305 +0000 UTC m=+1342.518102312" watchObservedRunningTime="2026-09-15 20:27:28.073223111 +0000 UTC m=+1342.518182119"
Sep 15 20:27:39.056804 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:39.056771    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:27:41.539203 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:41.539164    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:27:52.044161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:52.044114    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 20:27:52.044571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:52.044199    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 20:27:53.195406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.195372    2554 generic.go:356] "Generic (PLEG): container finished" podID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerID="dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010" exitCode=0
Sep 15 20:27:53.195854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.195433    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerDied","Data":"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"}
Sep 15 20:27:53.195854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.195830    2554 scope.go:117] "RemoveContainer" containerID="dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"
Sep 15 20:27:53.197063 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.197027    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:53.197161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.197102    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:53.197161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:53.197137    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:27:54.203852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:54.203819    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerStarted","Data":"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"}
Sep 15 20:27:54.761560 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:54.761521    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:54.761834 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:54.761809    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 15 20:27:54.761883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:54.761860    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 15 20:27:55.761777 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.761734    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 15 20:27:55.762231 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.761799    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 15 20:27:55.816965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.816927    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:27:55.817382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.817367    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="07bd2806-2600-4a07-ad7d-0ae30ba35fe7" containerName="istio-proxy"
Sep 15 20:27:55.819947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.819928    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.822594 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.822571    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"e2e-conflict-a-321b07e0-kserve-self-signed-certs\""
Sep 15 20:27:55.831429 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.831398    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:27:55.896814 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896775    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg48q\" (UniqueName: \"kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.897026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.897026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896874    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.897026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896907    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.897026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896932    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.897026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.896968    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998028 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.997959    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg48q\" (UniqueName: \"kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998045    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998072    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998110    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998143    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998229    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998512    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998538 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998536    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:55.998661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:55.998596    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:56.000582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.000550    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:56.000741 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.000722    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:56.008764 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.008733    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg48q\" (UniqueName: \"kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q\") pod \"e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:56.129847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.129749    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:27:56.442027 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.441971    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:27:56.446170 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:27:56.446135    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce2b2ea9_4de6_4bfa_84cc_99f3c86d98da.slice/crio-a45870fbc9ce7a7845342c2a5fa6ad703def9370dea61eef625b241e29439114 WatchSource:0}: Error finding container a45870fbc9ce7a7845342c2a5fa6ad703def9370dea61eef625b241e29439114: Status 404 returned error can't find the container with id a45870fbc9ce7a7845342c2a5fa6ad703def9370dea61eef625b241e29439114
Sep 15 20:27:56.761755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.761716    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 15 20:27:56.761945 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:56.761781    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 15 20:27:57.223608 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:57.223575    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" event={"ID":"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da","Type":"ContainerStarted","Data":"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"}
Sep 15 20:27:57.223789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:57.223619    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" event={"ID":"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da","Type":"ContainerStarted","Data":"a45870fbc9ce7a7845342c2a5fa6ad703def9370dea61eef625b241e29439114"}
Sep 15 20:27:57.242647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:57.242583    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" podStartSLOduration=2.242557294 podStartE2EDuration="2.242557294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:27:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:27:57.239529832 +0000 UTC m=+1371.684488840" watchObservedRunningTime="2026-09-15 20:27:57.242557294 +0000 UTC m=+1371.687516303"
Sep 15 20:27:57.761403 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:57.761356    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 15 20:27:57.761584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:57.761433    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 15 20:27:58.762337 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:58.762294    2554 patch_prober.go:28] interesting pod/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Sep 15 20:27:58.762757 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:58.762366    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Sep 15 20:27:59.765282 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:59.765246    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:59.765671 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:59.765517    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:27:59.766355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:27:59.766332    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:28:01.391626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.391592    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:28:01.395047 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.395025    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.399251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.399231    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-025acc06-openshift-default-dockercfg-xkwj8\""
Sep 15 20:28:01.416823 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.416743    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:28:01.454097 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454057    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454114    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454137    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454190    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtm4v\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454239    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454271    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454310    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454354    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.454446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.454385    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.555858    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.555925    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.555969    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtm4v\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556029    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556079    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556106    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556155    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556205    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.556276    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.557370    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.557451    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.557691    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.558025    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.559371    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.570011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.560570    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.576618 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.576386    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.577568 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.577512    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.580847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.580817    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtm4v\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v\") pod \"e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") " pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.706769 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.706730    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:01.985704 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.985626    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:28:01.988570 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:28:01.988545    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e204ff6_2404_43a8_a708_a43908501fb9.slice/crio-38a3408766b4c7f0ef7e12c45729ad990dadbe09d82cba36248b66371d998f9d WatchSource:0}: Error finding container 38a3408766b4c7f0ef7e12c45729ad990dadbe09d82cba36248b66371d998f9d: Status 404 returned error can't find the container with id 38a3408766b4c7f0ef7e12c45729ad990dadbe09d82cba36248b66371d998f9d
Sep 15 20:28:01.990865 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.990832    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:01.990964 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.990914    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:01.991050 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:01.990972    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:02.254363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:02.254262    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerStarted","Data":"3f21bcbacf4753473effe74cfa45aa9fc55593030c891d6c06006768013afdd8"}
Sep 15 20:28:02.254363 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:02.254325    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerStarted","Data":"38a3408766b4c7f0ef7e12c45729ad990dadbe09d82cba36248b66371d998f9d"}
Sep 15 20:28:02.276366 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:02.276295    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podStartSLOduration=1.276275595 podStartE2EDuration="1.276275595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:28:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:28:02.274613735 +0000 UTC m=+1376.719572744" watchObservedRunningTime="2026-09-15 20:28:02.276275595 +0000 UTC m=+1376.721234602"
Sep 15 20:28:02.707476 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:02.707450    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:03.712952 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:03.712916    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:04.265750 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:04.265718    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:04.266614 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:04.266591    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:04.373528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:04.373495    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:28:06.113354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:06.113324    2554 scope.go:117] "RemoveContainer" containerID="b4865f43b68c2da04a292f4167baa069bdf36a36f364e8e0eceb2992ba0d1089"
Sep 15 20:28:06.129948 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:06.129915    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:28:06.130133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:06.129977    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:28:06.144054 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:06.144031    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:28:06.290470 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:06.290444    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:28:34.493257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:34.492275    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:36214->10.134.0.61:15021: read: connection reset by peer" start-of-body=
Sep 15 20:28:34.493257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:34.492368    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": read tcp 10.134.0.2:36214->10.134.0.61:15021: read: connection reset by peer"
Sep 15 20:28:35.434455 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.434419    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e204ff6-2404-43a8-a708-a43908501fb9" containerID="3f21bcbacf4753473effe74cfa45aa9fc55593030c891d6c06006768013afdd8" exitCode=0
Sep 15 20:28:35.434659 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.434496    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerDied","Data":"3f21bcbacf4753473effe74cfa45aa9fc55593030c891d6c06006768013afdd8"}
Sep 15 20:28:35.434952 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.434930    2554 scope.go:117] "RemoveContainer" containerID="3f21bcbacf4753473effe74cfa45aa9fc55593030c891d6c06006768013afdd8"
Sep 15 20:28:35.436153 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.436119    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:35.436233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.436194    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:35.436233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:35.436226    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:28:36.442324 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:36.442292    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerStarted","Data":"9731225cf75f828b2a768d19546e476e670fe440f83acb1e4b60d5a8e085165a"}
Sep 15 20:28:36.707871 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:36.707835    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:36.708206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:36.708182    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:36.708268 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:36.708240    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:37.707879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:37.707840    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:37.708338 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:37.707899    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:38.707387 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:38.707344    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:38.707581 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:38.707406    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:39.231193 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:39.231156    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:28:39.707511 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:39.707481    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:39.707678 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:39.707536    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:40.296547 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.296510    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"]
Sep 15 20:28:40.300117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.300078    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:40.302709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.302686    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:28:40.302841 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.302714    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:28:40.307279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.307255    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"]
Sep 15 20:28:40.395430 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.395392    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb\" (UID: \"92789a5e-2ecb-4543-b51f-27831ebbc802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:40.496486 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.496446    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb\" (UID: \"92789a5e-2ecb-4543-b51f-27831ebbc802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:40.497122 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.497102    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb\" (UID: \"92789a5e-2ecb-4543-b51f-27831ebbc802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:40.612294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.612203    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:40.707784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.707310    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:40.707784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.707385    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:40.912528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:40.912494    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"]
Sep 15 20:28:40.914302 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:28:40.914270    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92789a5e_2ecb_4543_b51f_27831ebbc802.slice/crio-9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b WatchSource:0}: Error finding container 9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b: Status 404 returned error can't find the container with id 9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b
Sep 15 20:28:41.475924 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:41.475889    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb" event={"ID":"92789a5e-2ecb-4543-b51f-27831ebbc802","Type":"ContainerStarted","Data":"644f9dbec9bdf02df009f552d72c2f9cdefa4e3c398ff61fd67c8f90b9280f52"}
Sep 15 20:28:41.476337 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:41.475944    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb" event={"ID":"92789a5e-2ecb-4543-b51f-27831ebbc802","Type":"ContainerStarted","Data":"9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b"}
Sep 15 20:28:41.494398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:41.494343    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb" podStartSLOduration=1.494325145 podStartE2EDuration="1.494325145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:28:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:28:41.492448698 +0000 UTC m=+1415.937407718" watchObservedRunningTime="2026-09-15 20:28:41.494325145 +0000 UTC m=+1415.939284154"
Sep 15 20:28:41.707448 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:41.707417    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:41.707652 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:41.707481    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:42.483205 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:42.483171    2554 generic.go:356] "Generic (PLEG): container finished" podID="92789a5e-2ecb-4543-b51f-27831ebbc802" containerID="644f9dbec9bdf02df009f552d72c2f9cdefa4e3c398ff61fd67c8f90b9280f52" exitCode=0
Sep 15 20:28:42.483567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:42.483260    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb" event={"ID":"92789a5e-2ecb-4543-b51f-27831ebbc802","Type":"ContainerDied","Data":"644f9dbec9bdf02df009f552d72c2f9cdefa4e3c398ff61fd67c8f90b9280f52"}
Sep 15 20:28:42.708166 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:42.708122    2554 patch_prober.go:28] interesting pod/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused" start-of-body=
Sep 15 20:28:42.708342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:42.708182    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.61:15021/healthz/ready\": dial tcp 10.134.0.61:15021: connect: connection refused"
Sep 15 20:28:43.632449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.631578    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:43.711771 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.711734    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:43.712274 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.712259    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:43.712891 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.712875    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:28:43.726720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.726684    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca\") pod \"92789a5e-2ecb-4543-b51f-27831ebbc802\" (UID: \"92789a5e-2ecb-4543-b51f-27831ebbc802\") "
Sep 15 20:28:43.727088 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.727065    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "92789a5e-2ecb-4543-b51f-27831ebbc802" (UID: "92789a5e-2ecb-4543-b51f-27831ebbc802"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:28:43.828476 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:43.828379    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/92789a5e-2ecb-4543-b51f-27831ebbc802-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:28:44.498685 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:44.498653    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"
Sep 15 20:28:44.498869 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:44.498688    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb" event={"ID":"92789a5e-2ecb-4543-b51f-27831ebbc802","Type":"ContainerDied","Data":"9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b"}
Sep 15 20:28:44.498869 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:44.498737    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a16cb4de208757a3a1108cc33ca9bf56c24e1ac5aefa17e8121c18afd80669b"
Sep 15 20:28:51.073387 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:51.073351    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"]
Sep 15 20:28:51.076288 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:51.076254    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-01ea3b-pglfb"]
Sep 15 20:28:52.023861 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:52.023828    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92789a5e-2ecb-4543-b51f-27831ebbc802" path="/var/lib/kubelet/pods/92789a5e-2ecb-4543-b51f-27831ebbc802/volumes"
Sep 15 20:28:57.554266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:57.554220    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:28:57.554780 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:28:57.554516    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" containerID="cri-o://913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45" gracePeriod=30
Sep 15 20:29:02.651444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.651398    2554 patch_prober.go:28] interesting pod/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused" start-of-body=
Sep 15 20:29:02.651887 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.651478    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.26:15021/healthz/ready\": dial tcp 10.134.0.26:15021: connect: connection refused"
Sep 15 20:29:02.810413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.810383    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:29:02.929911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.929802    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.929911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.929877    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.929915    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5vkd\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.929951    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930037    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930089    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930120    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930147    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930157    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:02.930625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930231    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert\") pod \"e61a05a5-6848-4f40-bf31-02566aabe533\" (UID: \"e61a05a5-6848-4f40-bf31-02566aabe533\") "
Sep 15 20:29:02.930625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930391    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:02.930625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930401    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:02.930625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930410    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data" (OuterVolumeSpecName: "istio-data") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:02.930815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930629    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:02.930815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930654    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:02.930815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930669    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:02.930815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930682    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:02.930815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.930732    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:29:02.932290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.932256    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd" (OuterVolumeSpecName: "kube-api-access-x5vkd") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "kube-api-access-x5vkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:29:02.932434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.932359    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token" (OuterVolumeSpecName: "istio-token") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:29:02.932648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.932631    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:02.932648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:02.932635    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e61a05a5-6848-4f40-bf31-02566aabe533" (UID: "e61a05a5-6848-4f40-bf31-02566aabe533"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:29:03.031290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.031257    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e61a05a5-6848-4f40-bf31-02566aabe533-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:03.031290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.031287    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:03.031290 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.031295    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5vkd\" (UniqueName: \"kubernetes.io/projected/e61a05a5-6848-4f40-bf31-02566aabe533-kube-api-access-x5vkd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:03.031541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.031305    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e61a05a5-6848-4f40-bf31-02566aabe533-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:03.031541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.031313    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e61a05a5-6848-4f40-bf31-02566aabe533-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:03.598875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.598842    2554 generic.go:356] "Generic (PLEG): container finished" podID="e61a05a5-6848-4f40-bf31-02566aabe533" containerID="913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45" exitCode=0
Sep 15 20:29:03.599102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.598896    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"
Sep 15 20:29:03.599102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.598904    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerDied","Data":"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"}
Sep 15 20:29:03.599102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.598947    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879" event={"ID":"e61a05a5-6848-4f40-bf31-02566aabe533","Type":"ContainerDied","Data":"795a3410187b476f5bbcc21faa4221dd5398a2e2a765864193131998608cbc02"}
Sep 15 20:29:03.599102 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.598969    2554 scope.go:117] "RemoveContainer" containerID="913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"
Sep 15 20:29:03.609095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.609065    2554 scope.go:117] "RemoveContainer" containerID="005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"
Sep 15 20:29:03.617622 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.617603    2554 scope.go:117] "RemoveContainer" containerID="913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"
Sep 15 20:29:03.617953 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:29:03.617932    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45\": container with ID starting with 913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45 not found: ID does not exist" containerID="913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"
Sep 15 20:29:03.618059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.617961    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45"} err="failed to get container status \"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45\": rpc error: code = NotFound desc = could not find container \"913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45\": container with ID starting with 913b6f2a2c1ff2bc4e265a5264903b96768100ae14006d0f81b40fccb1611e45 not found: ID does not exist"
Sep 15 20:29:03.618059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.618010    2554 scope.go:117] "RemoveContainer" containerID="005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"
Sep 15 20:29:03.618334 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:29:03.618313    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf\": container with ID starting with 005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf not found: ID does not exist" containerID="005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"
Sep 15 20:29:03.618375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.618341    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf"} err="failed to get container status \"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf\": rpc error: code = NotFound desc = could not find container \"005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf\": container with ID starting with 005a56f7247edcee798f8bb3ea56b2b167bbb1ff7d2bc4e41abe6994cef148cf not found: ID does not exist"
Sep 15 20:29:03.624154 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.624120    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:29:03.628953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:03.628924    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-01ea3b-openshift-default-7b5794cf8b-sk879"]
Sep 15 20:29:04.023293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:04.023259    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" path="/var/lib/kubelet/pods/e61a05a5-6848-4f40-bf31-02566aabe533/volumes"
Sep 15 20:29:06.145230 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:06.145196    2554 scope.go:117] "RemoveContainer" containerID="a3547845d2ec32d6c054960a5b74b63df915eab97e260c3e7641d300d3d0fca1"
Sep 15 20:29:15.488362 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:15.488324    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:29:15.488774 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:15.488600    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" containerID="cri-o://6b2afc517fee4f66c8f02ffff4e37ae96e3f8d21428c01265bad26ca49cca7f2" gracePeriod=30
Sep 15 20:29:18.730436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:18.730392    2554 patch_prober.go:28] interesting pod/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 20:29:18.730816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:18.730471    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 20:29:19.865728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:19.865689    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:29:20.693277 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.693233    2554 generic.go:356] "Generic (PLEG): container finished" podID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerID="6b2afc517fee4f66c8f02ffff4e37ae96e3f8d21428c01265bad26ca49cca7f2" exitCode=0
Sep 15 20:29:20.693449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.693298    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerDied","Data":"6b2afc517fee4f66c8f02ffff4e37ae96e3f8d21428c01265bad26ca49cca7f2"}
Sep 15 20:29:20.693449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.693370    2554 scope.go:117] "RemoveContainer" containerID="850d345ca1a4386388e479609d95057e16f5740ab676ca9d28db61fbc1512c89"
Sep 15 20:29:20.758118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.758046    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:29:20.916225 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916175    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916250    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916304    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916332    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916378    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916436    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916471    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hknlg\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916496    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.916662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916572    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo\") pod \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\" (UID: \"9ca30b9c-ea1f-4158-bee6-36d4ede56737\") "
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916635    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916735    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916796    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916945    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.916963    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.917107    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:20.917132 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.917126    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:20.917512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.917139    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:20.917512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.917153    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:20.917512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.917180    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:20.918732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.918700    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg" (OuterVolumeSpecName: "kube-api-access-hknlg") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "kube-api-access-hknlg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:29:20.918732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.918720    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:29:20.918901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.918770    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:29:20.918901 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:20.918782    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ca30b9c-ea1f-4158-bee6-36d4ede56737" (UID: "9ca30b9c-ea1f-4158-bee6-36d4ede56737"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:29:21.017763 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.017663    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hknlg\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-kube-api-access-hknlg\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:21.017763 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.017694    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:21.017763 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.017703    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:21.017763 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.017712    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ca30b9c-ea1f-4158-bee6-36d4ede56737-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:29:21.701079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.701045    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"
Sep 15 20:29:21.701288 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.701089    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9" event={"ID":"9ca30b9c-ea1f-4158-bee6-36d4ede56737","Type":"ContainerDied","Data":"7f82f96da9413f20274ca5c4ff6bd129333cc5ec0746b1ae575b04ae12dc9a8c"}
Sep 15 20:29:21.701288 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.701151    2554 scope.go:117] "RemoveContainer" containerID="6b2afc517fee4f66c8f02ffff4e37ae96e3f8d21428c01265bad26ca49cca7f2"
Sep 15 20:29:21.727571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.727527    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:29:21.730060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:21.730027    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-39c7b0-openshift-default-86cd978564-f5cx9"]
Sep 15 20:29:22.025415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:22.025380    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" path="/var/lib/kubelet/pods/9ca30b9c-ea1f-4158-bee6-36d4ede56737/volumes"
Sep 15 20:29:26.415252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415211    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:29:26.415758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415734    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415762    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415785    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415794    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415812    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92789a5e-2ecb-4543-b51f-27831ebbc802" containerName="revoke-keys"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415821    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="92789a5e-2ecb-4543-b51f-27831ebbc802" containerName="revoke-keys"
Sep 15 20:29:26.415838 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415835    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.416184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415843    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.416184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415927    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:26.416184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415940    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.416184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415953    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="92789a5e-2ecb-4543-b51f-27831ebbc802" containerName="revoke-keys"
Sep 15 20:29:26.416184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.415962    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e61a05a5-6848-4f40-bf31-02566aabe533" containerName="istio-proxy"
Sep 15 20:29:26.420503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.420481    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.423011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.422964    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-725e67\"/\"e2e-conflict-b-321b07e0-kserve-self-signed-certs\""
Sep 15 20:29:26.426884 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.426856    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:29:26.467856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.467819    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.468040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.467878    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.468040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.467946    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57fmk\" (UniqueName: \"kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.468040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.468026    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.468173 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.468050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.468173 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.468068    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569500 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569462    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569517    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569553    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57fmk\" (UniqueName: \"kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569574    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569599    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.569698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.569617    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.570154 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.570110    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.570294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.570156    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.570294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.570133    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.571998 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.571963    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.572254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.572237    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.577441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.577413    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-57fmk\" (UniqueName: \"kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk\") pod \"e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") " pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:26.730384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:26.730355    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:27.005571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:27.005544    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:29:27.007604 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:29:27.007574    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod366373d9_f2f8_40c7_b996_88424aa0eb7a.slice/crio-11eb8732ce8d8f53cbc6ebe76a31d21a2db6ebfec62418f2f1ae544300ac4efc WatchSource:0}: Error finding container 11eb8732ce8d8f53cbc6ebe76a31d21a2db6ebfec62418f2f1ae544300ac4efc: Status 404 returned error can't find the container with id 11eb8732ce8d8f53cbc6ebe76a31d21a2db6ebfec62418f2f1ae544300ac4efc
Sep 15 20:29:27.743643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:27.743603    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" event={"ID":"366373d9-f2f8-40c7-b996-88424aa0eb7a","Type":"ContainerStarted","Data":"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"}
Sep 15 20:29:27.743643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:27.743650    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" event={"ID":"366373d9-f2f8-40c7-b996-88424aa0eb7a","Type":"ContainerStarted","Data":"11eb8732ce8d8f53cbc6ebe76a31d21a2db6ebfec62418f2f1ae544300ac4efc"}
Sep 15 20:29:27.762353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:27.762299    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" podStartSLOduration=1.762283592 podStartE2EDuration="1.762283592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:29:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:29:27.760813162 +0000 UTC m=+1462.205772171" watchObservedRunningTime="2026-09-15 20:29:27.762283592 +0000 UTC m=+1462.207242639"
Sep 15 20:29:36.731186 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:36.731144    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:36.731779 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:36.731202    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:36.743839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:36.743810    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:36.800740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:36.800713    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:29:56.240782 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:56.240745    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:29:59.315109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.315072    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:29:59.315602 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.315580    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:59.315676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.315606    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:59.315747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.315734    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca30b9c-ea1f-4158-bee6-36d4ede56737" containerName="istio-proxy"
Sep 15 20:29:59.318791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.318771    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.321164 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.321140    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-e80b38\""
Sep 15 20:29:59.329647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.329620    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:29:59.366798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.366765    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:29:59.370057 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.370040    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.372867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.372845    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-e80b38-dockercfg-q6rqc\""
Sep 15 20:29:59.386497 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.386464    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:29:59.499474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.499427    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.499474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.499479    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rbgn\" (UniqueName: \"kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.499715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.499496    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thn4b\" (UniqueName: \"kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.499715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.499613    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.600854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.600743    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.600854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.600802    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rbgn\" (UniqueName: \"kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.600854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.600822    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thn4b\" (UniqueName: \"kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.601179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.600877    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.601584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.601557    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.601758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.601736    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.608657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.608633    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rbgn\" (UniqueName: \"kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn\") pod \"payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.608786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.608690    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-thn4b\" (UniqueName: \"kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b\") pod \"payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.630529 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.630498    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:29:59.682730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.682699    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:29:59.905514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.905256    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:29:59.908293 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:29:59.908259    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82de4092_c0d1_46a8_a6c3_92e71c4a7b30.slice/crio-7044ee724930f4ee1c7f09dae8080afdd5c83eb200a3b1ce58ae3aa7a8acfc52 WatchSource:0}: Error finding container 7044ee724930f4ee1c7f09dae8080afdd5c83eb200a3b1ce58ae3aa7a8acfc52: Status 404 returned error can't find the container with id 7044ee724930f4ee1c7f09dae8080afdd5c83eb200a3b1ce58ae3aa7a8acfc52
Sep 15 20:29:59.992644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:29:59.992618    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:29:59.994626 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:29:59.994597    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf26d6cd5_0f53_4b9f_a32a_dd854df0a522.slice/crio-180f8effc7f5f7afa4c47754eb55b06d70c42a4cdb1ee34f7d0cf33fe77144d2 WatchSource:0}: Error finding container 180f8effc7f5f7afa4c47754eb55b06d70c42a4cdb1ee34f7d0cf33fe77144d2: Status 404 returned error can't find the container with id 180f8effc7f5f7afa4c47754eb55b06d70c42a4cdb1ee34f7d0cf33fe77144d2
Sep 15 20:30:00.140338 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.140299    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"]
Sep 15 20:30:00.144766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.144727    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"]
Sep 15 20:30:00.144766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.144763    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"
Sep 15 20:30:00.147382 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.147357    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:30:00.148198 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.148175    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"
Sep 15 20:30:00.157644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.155933    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"]
Sep 15 20:30:00.162680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.159689    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"]
Sep 15 20:30:00.162680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.162135    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"
Sep 15 20:30:00.170235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.170200    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"]
Sep 15 20:30:00.173336 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.173176    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"
Sep 15 20:30:00.174325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.174304    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"
Sep 15 20:30:00.174435 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.174307    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:00.179441 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.179414    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"
Sep 15 20:30:00.183024 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.182999    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"]
Sep 15 20:30:00.191267 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.188222    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:00.192736 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.192452    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"
Sep 15 20:30:00.202969 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.202941    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"
Sep 15 20:30:00.479926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.479897    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"]
Sep 15 20:30:00.483112 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:30:00.483058    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8889975c_870d_4fb8_addd_e44621e30bc0.slice/crio-087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc WatchSource:0}: Error finding container 087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc: Status 404 returned error can't find the container with id 087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc
Sep 15 20:30:00.502172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.502086    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"]
Sep 15 20:30:00.505120 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:30:00.505041    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41ed2adf_1b66_4204_a88a_d918e2031436.slice/crio-a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c WatchSource:0}: Error finding container a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c: Status 404 returned error can't find the container with id a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c
Sep 15 20:30:00.508831 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.508806    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"]
Sep 15 20:30:00.515669 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.515648    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:00.520377 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:30:00.520350    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6774259_0e92_4f1e_b01e_55e80418891e.slice/crio-b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53 WatchSource:0}: Error finding container b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53: Status 404 returned error can't find the container with id b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53
Sep 15 20:30:00.520662 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:30:00.520635    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda762eafa_c2fb_47c3_9591_bb26a7b07634.slice/crio-357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10 WatchSource:0}: Error finding container 357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10: Status 404 returned error can't find the container with id 357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10
Sep 15 20:30:00.918478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.918436    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" event={"ID":"f26d6cd5-0f53-4b9f-a32a-dd854df0a522","Type":"ContainerStarted","Data":"ff886b5e5568c2fd1322f6c5eb573313b90c8807cffefadac9a3da742b49ed0d"}
Sep 15 20:30:00.918690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.918505    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" event={"ID":"f26d6cd5-0f53-4b9f-a32a-dd854df0a522","Type":"ContainerStarted","Data":"180f8effc7f5f7afa4c47754eb55b06d70c42a4cdb1ee34f7d0cf33fe77144d2"}
Sep 15 20:30:00.918690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.918634    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:30:00.920160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.920135    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" event={"ID":"82de4092-c0d1-46a8-a6c3-92e71c4a7b30","Type":"ContainerStarted","Data":"9f404f18037bb1f0c74361683246061ea8797a5171a2c72d3557ef3c98c9ee18"}
Sep 15 20:30:00.920279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.920184    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" event={"ID":"82de4092-c0d1-46a8-a6c3-92e71c4a7b30","Type":"ContainerStarted","Data":"7044ee724930f4ee1c7f09dae8080afdd5c83eb200a3b1ce58ae3aa7a8acfc52"}
Sep 15 20:30:00.920279 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.920216    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:30:00.921526 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.921501    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" event={"ID":"a762eafa-c2fb-47c3-9591-bb26a7b07634","Type":"ContainerStarted","Data":"357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10"}
Sep 15 20:30:00.922798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.922778    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g" event={"ID":"41ed2adf-1b66-4204-a88a-d918e2031436","Type":"ContainerStarted","Data":"a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c"}
Sep 15 20:30:00.924409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.924389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt" event={"ID":"8889975c-870d-4fb8-addd-e44621e30bc0","Type":"ContainerStarted","Data":"39a101fa4ab4b6728c5c597caa26b5963bf8502dfd858560732f1f021d3fc406"}
Sep 15 20:30:00.924513 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.924429    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt" event={"ID":"8889975c-870d-4fb8-addd-e44621e30bc0","Type":"ContainerStarted","Data":"087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc"}
Sep 15 20:30:00.925620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.925598    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz" event={"ID":"a6774259-0e92-4f1e-b01e-55e80418891e","Type":"ContainerStarted","Data":"b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53"}
Sep 15 20:30:00.937639 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.937574    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" podStartSLOduration=1.9375542000000001 podStartE2EDuration="1.9375542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:30:00.935208238 +0000 UTC m=+1495.380167248" watchObservedRunningTime="2026-09-15 20:30:00.9375542 +0000 UTC m=+1495.382513210"
Sep 15 20:30:00.954933 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.954869    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt" podStartSLOduration=0.954844137 podStartE2EDuration="954.844137ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:30:00.95077069 +0000 UTC m=+1495.395729696" watchObservedRunningTime="2026-09-15 20:30:00.954844137 +0000 UTC m=+1495.399803147"
Sep 15 20:30:00.970815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:00.970738    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" podStartSLOduration=1.9707025329999999 podStartE2EDuration="1.970702533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:30:00.969945663 +0000 UTC m=+1495.414904673" watchObservedRunningTime="2026-09-15 20:30:00.970702533 +0000 UTC m=+1495.415661545"
Sep 15 20:30:01.932965 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.932931    2554 generic.go:356] "Generic (PLEG): container finished" podID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerID="523e9e8f7b5a0a184bf63313e0615869cf3d7d66ebdd2d394b93acb1571d5c09" exitCode=7
Sep 15 20:30:01.933406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.933030    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" event={"ID":"a762eafa-c2fb-47c3-9591-bb26a7b07634","Type":"ContainerDied","Data":"523e9e8f7b5a0a184bf63313e0615869cf3d7d66ebdd2d394b93acb1571d5c09"}
Sep 15 20:30:01.933406 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.933185    2554 scope.go:117] "RemoveContainer" containerID="523e9e8f7b5a0a184bf63313e0615869cf3d7d66ebdd2d394b93acb1571d5c09"
Sep 15 20:30:01.934801 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.934779    2554 generic.go:356] "Generic (PLEG): container finished" podID="41ed2adf-1b66-4204-a88a-d918e2031436" containerID="12d6b939078401e0863776c1491590e52ab35180a301638153da87a93b53d52d" exitCode=0
Sep 15 20:30:01.934914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.934841    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g" event={"ID":"41ed2adf-1b66-4204-a88a-d918e2031436","Type":"ContainerDied","Data":"12d6b939078401e0863776c1491590e52ab35180a301638153da87a93b53d52d"}
Sep 15 20:30:01.936683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.936651    2554 generic.go:356] "Generic (PLEG): container finished" podID="8889975c-870d-4fb8-addd-e44621e30bc0" containerID="39a101fa4ab4b6728c5c597caa26b5963bf8502dfd858560732f1f021d3fc406" exitCode=0
Sep 15 20:30:01.936794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.936678    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt" event={"ID":"8889975c-870d-4fb8-addd-e44621e30bc0","Type":"ContainerDied","Data":"39a101fa4ab4b6728c5c597caa26b5963bf8502dfd858560732f1f021d3fc406"}
Sep 15 20:30:01.938364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.938342    2554 generic.go:356] "Generic (PLEG): container finished" podID="a6774259-0e92-4f1e-b01e-55e80418891e" containerID="6e4a2c750ab023d9839e5e56025f0e460f52324682b6b51cb5a2f14891aee01e" exitCode=0
Sep 15 20:30:01.938454 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:01.938428    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz" event={"ID":"a6774259-0e92-4f1e-b01e-55e80418891e","Type":"ContainerDied","Data":"6e4a2c750ab023d9839e5e56025f0e460f52324682b6b51cb5a2f14891aee01e"}
Sep 15 20:30:02.950445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:02.950351    2554 generic.go:356] "Generic (PLEG): container finished" podID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerID="e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92" exitCode=7
Sep 15 20:30:02.950886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:02.950435    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" event={"ID":"a762eafa-c2fb-47c3-9591-bb26a7b07634","Type":"ContainerDied","Data":"e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92"}
Sep 15 20:30:02.950886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:02.950513    2554 scope.go:117] "RemoveContainer" containerID="523e9e8f7b5a0a184bf63313e0615869cf3d7d66ebdd2d394b93acb1571d5c09"
Sep 15 20:30:02.950886 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:02.950698    2554 scope.go:117] "RemoveContainer" containerID="e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92"
Sep 15 20:30:02.951059 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:30:02.951038    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt_odh-ai-gateway-infra(a762eafa-c2fb-47c3-9591-bb26a7b07634)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634"
Sep 15 20:30:03.140077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.140050    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"
Sep 15 20:30:03.142491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.142462    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"
Sep 15 20:30:03.178373 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.178344    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"
Sep 15 20:30:03.958710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.958680    2554 scope.go:117] "RemoveContainer" containerID="e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92"
Sep 15 20:30:03.959214 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:30:03.958968    2554 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt_odh-ai-gateway-infra(a762eafa-c2fb-47c3-9591-bb26a7b07634)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634"
Sep 15 20:30:03.959879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.959858    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"
Sep 15 20:30:03.959879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.959867    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g" event={"ID":"41ed2adf-1b66-4204-a88a-d918e2031436","Type":"ContainerDied","Data":"a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c"}
Sep 15 20:30:03.960075 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.959913    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4a61e749641019dc4899ab2b781667726a033864c747d0e4e27ac4f1c6dcf9c"
Sep 15 20:30:03.961314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.961295    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt"
Sep 15 20:30:03.961314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.961306    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29825070-kfxrt" event={"ID":"8889975c-870d-4fb8-addd-e44621e30bc0","Type":"ContainerDied","Data":"087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc"}
Sep 15 20:30:03.961474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.961343    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="087f71a30a964be272311133ea62dacfd849e6fcd5b027e8e144af28fcd351fc"
Sep 15 20:30:03.962653 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.962632    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz" event={"ID":"a6774259-0e92-4f1e-b01e-55e80418891e","Type":"ContainerDied","Data":"b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53"}
Sep 15 20:30:03.962754 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.962668    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"
Sep 15 20:30:03.962754 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:03.962675    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5706ceddf60392df1d23b89470482827a59ea693876aab0d398971bd3e29a53"
Sep 15 20:30:06.171625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:06.171589    2554 scope.go:117] "RemoveContainer" containerID="53ee452bd6ad1cddc2ef60ddace5069654199fedb74ef53624e811518d8abefa"
Sep 15 20:30:06.180120 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:06.180101    2554 scope.go:117] "RemoveContainer" containerID="0b994e81ca3544737a4cc6cc63ba61ecfa5eb53af2932e6e98d8d3a2c3f68916"
Sep 15 20:30:06.188278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:06.188258    2554 scope.go:117] "RemoveContainer" containerID="6554914bfc70628a56885b9fdb20e6a796cbf1eb4bc4249fcdf9dc0df35bfe2b"
Sep 15 20:30:11.941245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:11.941212    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:30:11.941868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:11.941476    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:30:16.021302 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:16.021273    2554 scope.go:117] "RemoveContainer" containerID="e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92"
Sep 15 20:30:17.045970 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:17.045932    2554 generic.go:356] "Generic (PLEG): container finished" podID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerID="011d919f5c5bb64df679201833625d3d3c6df1b6cd7f2bd512209e5914933d54" exitCode=0
Sep 15 20:30:17.046444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:17.046010    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" event={"ID":"a762eafa-c2fb-47c3-9591-bb26a7b07634","Type":"ContainerDied","Data":"011d919f5c5bb64df679201833625d3d3c6df1b6cd7f2bd512209e5914933d54"}
Sep 15 20:30:17.046444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:17.046074    2554 scope.go:117] "RemoveContainer" containerID="e8fbaf9611864a695149020bdbab0710bb5a0c5045a7d3d6701786abb72dfe92"
Sep 15 20:30:18.078118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:18.078079    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:18.195438 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:18.195409    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"
Sep 15 20:30:19.059911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:19.059874    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt" event={"ID":"a762eafa-c2fb-47c3-9591-bb26a7b07634","Type":"ContainerDied","Data":"357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10"}
Sep 15 20:30:19.059911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:19.059893    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"
Sep 15 20:30:19.059911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:19.059922    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="357247d03afa5ffed6d1df9e916a916f8b3682b7a37d540bf39031943710bb10"
Sep 15 20:30:19.088373 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:19.088338    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:19.099827 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:19.095150    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-e80b38-29825070-xp2pt"]
Sep 15 20:30:20.023251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:20.023208    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" path="/var/lib/kubelet/pods/a762eafa-c2fb-47c3-9591-bb26a7b07634/volumes"
Sep 15 20:30:37.039061 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:37.038968    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:30:48.912584 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:48.912539    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:30:57.680540 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:57.680506    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"]
Sep 15 20:30:57.685214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:57.685185    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-025acc06-29825070-j4pwz"]
Sep 15 20:30:58.025003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:30:58.024952    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6774259-0e92-4f1e-b01e-55e80418891e" path="/var/lib/kubelet/pods/a6774259-0e92-4f1e-b01e-55e80418891e/volumes"
Sep 15 20:31:00.914232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:00.914196    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:31:03.932347 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:03.932279    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" podUID="366373d9-f2f8-40c7-b996-88424aa0eb7a" containerName="main" containerID="cri-o://f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f" gracePeriod=45
Sep 15 20:31:04.187409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.187335    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:31:04.303079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.303045    2554 generic.go:356] "Generic (PLEG): container finished" podID="366373d9-f2f8-40c7-b996-88424aa0eb7a" containerID="f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f" exitCode=0
Sep 15 20:31:04.303263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.303086    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"
Sep 15 20:31:04.303263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.303119    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" event={"ID":"366373d9-f2f8-40c7-b996-88424aa0eb7a","Type":"ContainerDied","Data":"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"}
Sep 15 20:31:04.303263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.303150    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr" event={"ID":"366373d9-f2f8-40c7-b996-88424aa0eb7a","Type":"ContainerDied","Data":"11eb8732ce8d8f53cbc6ebe76a31d21a2db6ebfec62418f2f1ae544300ac4efc"}
Sep 15 20:31:04.303263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.303166    2554 scope.go:117] "RemoveContainer" containerID="f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"
Sep 15 20:31:04.311873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.311852    2554 scope.go:117] "RemoveContainer" containerID="f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"
Sep 15 20:31:04.312258 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:31:04.312234    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f\": container with ID starting with f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f not found: ID does not exist" containerID="f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"
Sep 15 20:31:04.312335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.312277    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f"} err="failed to get container status \"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f\": rpc error: code = NotFound desc = could not find container \"f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f\": container with ID starting with f8e3b56ffecd53bbe2945792fc1874a6eb9ef15d24d9712eb6978dee112c127f not found: ID does not exist"
Sep 15 20:31:04.336880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.336844    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.336880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.336892    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.337140 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.336938    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.337140 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.336971    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.337140 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337048    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.337140 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337075    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-57fmk\" (UniqueName: \"kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk\") pod \"366373d9-f2f8-40c7-b996-88424aa0eb7a\" (UID: \"366373d9-f2f8-40c7-b996-88424aa0eb7a\") "
Sep 15 20:31:04.337360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337218    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home" (OuterVolumeSpecName: "home") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:04.337360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337235    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:04.337360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337246    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache" (OuterVolumeSpecName: "model-cache") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:04.337490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337434    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.337490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337481    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.337591 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.337497    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.339397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.339373    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm" (OuterVolumeSpecName: "dshm") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:04.339397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.339386    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:31:04.339515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.339442    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk" (OuterVolumeSpecName: "kube-api-access-57fmk") pod "366373d9-f2f8-40c7-b996-88424aa0eb7a" (UID: "366373d9-f2f8-40c7-b996-88424aa0eb7a"). InnerVolumeSpecName "kube-api-access-57fmk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:31:04.438114 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.438019    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/366373d9-f2f8-40c7-b996-88424aa0eb7a-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.438114 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.438053    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-57fmk\" (UniqueName: \"kubernetes.io/projected/366373d9-f2f8-40c7-b996-88424aa0eb7a-kube-api-access-57fmk\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.438114 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.438063    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/366373d9-f2f8-40c7-b996-88424aa0eb7a-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:04.626903 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.626868    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:31:04.631661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:04.631625    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-b-321b07e0-kserve-5d6ddd9645-482qr"]
Sep 15 20:31:06.024416 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:06.024383    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="366373d9-f2f8-40c7-b996-88424aa0eb7a" path="/var/lib/kubelet/pods/366373d9-f2f8-40c7-b996-88424aa0eb7a/volumes"
Sep 15 20:31:15.626449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.626406    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:31:15.626995 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.626967    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627000    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627017    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6774259-0e92-4f1e-b01e-55e80418891e" containerName="cleanup"
Sep 15 20:31:15.627056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627026    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6774259-0e92-4f1e-b01e-55e80418891e" containerName="cleanup"
Sep 15 20:31:15.627056 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627049    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="366373d9-f2f8-40c7-b996-88424aa0eb7a" containerName="main"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627058    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="366373d9-f2f8-40c7-b996-88424aa0eb7a" containerName="main"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627074    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627082    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627094    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627102    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627121    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41ed2adf-1b66-4204-a88a-d918e2031436" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627130    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="41ed2adf-1b66-4204-a88a-d918e2031436" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627143    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8889975c-870d-4fb8-addd-e44621e30bc0" containerName="cleanup"
Sep 15 20:31:15.627191 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627150    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8889975c-870d-4fb8-addd-e44621e30bc0" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627246    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="41ed2adf-1b66-4204-a88a-d918e2031436" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627259    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6774259-0e92-4f1e-b01e-55e80418891e" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627269    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8889975c-870d-4fb8-addd-e44621e30bc0" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627278    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627286    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627298    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="a762eafa-c2fb-47c3-9591-bb26a7b07634" containerName="cleanup"
Sep 15 20:31:15.627474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.627308    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="366373d9-f2f8-40c7-b996-88424aa0eb7a" containerName="main"
Sep 15 20:31:15.630642 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.630620    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.633104 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.633078    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"kube-root-ca.crt\""
Sep 15 20:31:15.634262 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.634237    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"openshift-service-ca.crt\""
Sep 15 20:31:15.634440 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.634254    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"default-dockercfg-lgr7w\""
Sep 15 20:31:15.634576 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.634289    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"auth-test-model-e80b38-kserve-self-signed-certs\""
Sep 15 20:31:15.637289 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.637267    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:31:15.652010 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.651966    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nt29k\" (UniqueName: \"kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.652219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.652050    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.652219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.652081    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.652219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.652118    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.652219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.652154    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.652219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.652176    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753355 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753315    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nt29k\" (UniqueName: \"kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753380    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753402    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753442    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753469    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753489    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753803    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753904 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753878    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.753946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.753908    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.755783 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.755754    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.756198 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.756175    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.764633 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.764607    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nt29k\" (UniqueName: \"kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k\") pod \"auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:15.934312 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.934222    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" podUID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" containerName="main" containerID="cri-o://e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19" gracePeriod=45
Sep 15 20:31:15.942847 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:15.942815    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:16.179813 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.179786    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:31:16.214947 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.214920    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:31:16.217257 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:31:16.217228    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode57749f7_23cc_4124_8ca6_d02a447487d8.slice/crio-143d7f613e85a821165870a9ddd4f1184f4e5edc6b4353fc6529318f2211f7d8 WatchSource:0}: Error finding container 143d7f613e85a821165870a9ddd4f1184f4e5edc6b4353fc6529318f2211f7d8: Status 404 returned error can't find the container with id 143d7f613e85a821165870a9ddd4f1184f4e5edc6b4353fc6529318f2211f7d8
Sep 15 20:31:16.257151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257121    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hg48q\" (UniqueName: \"kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257169    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257200    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257250    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257321 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257300    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257523 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257343    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home\") pod \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\" (UID: \"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da\") "
Sep 15 20:31:16.257674 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257640    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home" (OuterVolumeSpecName: "home") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:16.257747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257726    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache" (OuterVolumeSpecName: "model-cache") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:16.257818 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.257752    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:16.259529 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.259498    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:31:16.259656 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.259533    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm" (OuterVolumeSpecName: "dshm") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:16.259656 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.259595    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q" (OuterVolumeSpecName: "kube-api-access-hg48q") pod "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" (UID: "ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da"). InnerVolumeSpecName "kube-api-access-hg48q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:31:16.358415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358380    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.358415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358406    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.358415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358418    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.358683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358429    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg48q\" (UniqueName: \"kubernetes.io/projected/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-kube-api-access-hg48q\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.358683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358441    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.358683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.358452    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:16.371070 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.371033    2554 generic.go:356] "Generic (PLEG): container finished" podID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" containerID="e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19" exitCode=0
Sep 15 20:31:16.371232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.371090    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"
Sep 15 20:31:16.371232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.371129    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" event={"ID":"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da","Type":"ContainerDied","Data":"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"}
Sep 15 20:31:16.371232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.371170    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t" event={"ID":"ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da","Type":"ContainerDied","Data":"a45870fbc9ce7a7845342c2a5fa6ad703def9370dea61eef625b241e29439114"}
Sep 15 20:31:16.371232 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.371194    2554 scope.go:117] "RemoveContainer" containerID="e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"
Sep 15 20:31:16.372915 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.372890    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" event={"ID":"e57749f7-23cc-4124-8ca6-d02a447487d8","Type":"ContainerStarted","Data":"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"}
Sep 15 20:31:16.373077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.372924    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" event={"ID":"e57749f7-23cc-4124-8ca6-d02a447487d8","Type":"ContainerStarted","Data":"143d7f613e85a821165870a9ddd4f1184f4e5edc6b4353fc6529318f2211f7d8"}
Sep 15 20:31:16.380754 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.380729    2554 scope.go:117] "RemoveContainer" containerID="e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"
Sep 15 20:31:16.381102 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:31:16.381081    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19\": container with ID starting with e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19 not found: ID does not exist" containerID="e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"
Sep 15 20:31:16.381179 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.381115    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19"} err="failed to get container status \"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19\": rpc error: code = NotFound desc = could not find container \"e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19\": container with ID starting with e772bf0ad0f161a5a27fcbadfc5aab6932999e8c6bf4473ad5e06fff8650de19 not found: ID does not exist"
Sep 15 20:31:16.391591 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.391541    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" podStartSLOduration=1.391524203 podStartE2EDuration="1.391524203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:31:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:31:16.390673381 +0000 UTC m=+1570.835632403" watchObservedRunningTime="2026-09-15 20:31:16.391524203 +0000 UTC m=+1570.836483240"
Sep 15 20:31:16.404616 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.404581    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:31:16.409114 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:16.409075    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/e2e-conflict-a-321b07e0-kserve-79f4ff6cf9-bzv7t"]
Sep 15 20:31:18.024029 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:18.023969    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" path="/var/lib/kubelet/pods/ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da/volumes"
Sep 15 20:31:18.138629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:18.138592    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:31:25.943720 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:25.943672    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:25.944181 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:25.943743    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:25.956953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:25.956919    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:26.438471 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:26.438433    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:31:49.416541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:49.416502    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:31:49.417431 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:49.416744    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy" containerID="cri-o://9731225cf75f828b2a768d19546e476e670fe440f83acb1e4b60d5a8e085165a" gracePeriod=30
Sep 15 20:31:50.730927 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:50.730890    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:31:54.583404 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.583372    2554 generic.go:356] "Generic (PLEG): container finished" podID="5e204ff6-2404-43a8-a708-a43908501fb9" containerID="9731225cf75f828b2a768d19546e476e670fe440f83acb1e4b60d5a8e085165a" exitCode=0
Sep 15 20:31:54.583806 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.583441    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerDied","Data":"9731225cf75f828b2a768d19546e476e670fe440f83acb1e4b60d5a8e085165a"}
Sep 15 20:31:54.583806 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.583500    2554 scope.go:117] "RemoveContainer" containerID="3f21bcbacf4753473effe74cfa45aa9fc55593030c891d6c06006768013afdd8"
Sep 15 20:31:54.679331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.679249    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:31:54.832752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832711    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.832752 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832760    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832782    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832820    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832842    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832879    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xtm4v\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.832900    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833014    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833052    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket\") pod \"5e204ff6-2404-43a8-a708-a43908501fb9\" (UID: \"5e204ff6-2404-43a8-a708-a43908501fb9\") "
Sep 15 20:31:54.833468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833164    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:54.833468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833376    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.833468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833390    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:54.833468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833425    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:54.833684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833586    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:54.833684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.833620    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:31:54.835100 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.835067    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:31:54.835100 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.835086    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:31:54.835282 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.835128    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:31:54.835455 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.835439    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v" (OuterVolumeSpecName: "kube-api-access-xtm4v") pod "5e204ff6-2404-43a8-a708-a43908501fb9" (UID: "5e204ff6-2404-43a8-a708-a43908501fb9"). InnerVolumeSpecName "kube-api-access-xtm4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934425    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934465    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e204ff6-2404-43a8-a708-a43908501fb9-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934478    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934492    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xtm4v\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-kube-api-access-xtm4v\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934507    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e204ff6-2404-43a8-a708-a43908501fb9-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934520    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934532    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e204ff6-2404-43a8-a708-a43908501fb9-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:54.934883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:54.934545    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e204ff6-2404-43a8-a708-a43908501fb9-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:31:55.590344 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:55.590315    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"
Sep 15 20:31:55.590810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:55.590357    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx" event={"ID":"5e204ff6-2404-43a8-a708-a43908501fb9","Type":"ContainerDied","Data":"38a3408766b4c7f0ef7e12c45729ad990dadbe09d82cba36248b66371d998f9d"}
Sep 15 20:31:55.590810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:55.590422    2554 scope.go:117] "RemoveContainer" containerID="9731225cf75f828b2a768d19546e476e670fe440f83acb1e4b60d5a8e085165a"
Sep 15 20:31:55.611249 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:55.611218    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:31:55.615313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:55.615287    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-025acc06-openshift-default-68b54dc484-wqnkx"]
Sep 15 20:31:56.023954 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:31:56.023918    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" path="/var/lib/kubelet/pods/5e204ff6-2404-43a8-a708-a43908501fb9/volumes"
Sep 15 20:32:21.223109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223075    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:32:21.223726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223613    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" containerName="main"
Sep 15 20:32:21.223726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223634    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" containerName="main"
Sep 15 20:32:21.223726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223654    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:21.223726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223664    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:21.223955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223793    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce2b2ea9-4de6-4bfa-84cc-99f3c86d98da" containerName="main"
Sep 15 20:32:21.223955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223810    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:21.223955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.223819    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:21.227162 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.227133    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.229798 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.229772    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-7e3543\"/\"embedding-w0-7e3543-kserve-self-signed-certs\""
Sep 15 20:32:21.235574 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.235543    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:32:21.380206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380167    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.380388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380219    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgg87\" (UniqueName: \"kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.380388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380246    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.380388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380309    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.380388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380384    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.380550 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.380408    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.481695 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481575    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.481695 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481638    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.481695 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481688    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481725    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgg87\" (UniqueName: \"kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481861    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.481938    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482183 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.482162    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482223 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.482182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.482365 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.482343    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.484094 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.484066    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.484342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.484323    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.490536 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.490514    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgg87\" (UniqueName: \"kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87\") pod \"embedding-w0-7e3543-kserve-678bf596cf-p7cgv\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") " pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.537776 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.537732    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:21.809130 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:21.809102    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:32:21.810741 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:32:21.810713    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd8c8b0c5_d60e_4a00_8f27_56d0bc8ac53f.slice/crio-7b169936851b532a01072caa888bf7bc1baea19a297c6796ee7edc9633f665ab WatchSource:0}: Error finding container 7b169936851b532a01072caa888bf7bc1baea19a297c6796ee7edc9633f665ab: Status 404 returned error can't find the container with id 7b169936851b532a01072caa888bf7bc1baea19a297c6796ee7edc9633f665ab
Sep 15 20:32:22.732180 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:22.732138    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" event={"ID":"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f","Type":"ContainerStarted","Data":"bdb67ebff0d9e59e4fc7d262e676ec10fba638ceba7a4bad8e5e14dd4f16664b"}
Sep 15 20:32:22.732596 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:22.732191    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" event={"ID":"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f","Type":"ContainerStarted","Data":"7b169936851b532a01072caa888bf7bc1baea19a297c6796ee7edc9633f665ab"}
Sep 15 20:32:22.754106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:22.754049    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" podStartSLOduration=1.754029375 podStartE2EDuration="1.754029375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:32:22.752846712 +0000 UTC m=+1637.197805723" watchObservedRunningTime="2026-09-15 20:32:22.754029375 +0000 UTC m=+1637.198988383"
Sep 15 20:32:22.928472 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:22.928432    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:32:31.538856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:31.538812    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:31.539405 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:31.538883    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:31.551583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:31.551552    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:31.789791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:31.789679    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:32:44.375541 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.375503    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:32:44.376094 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.376075    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:44.376182 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.376097    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e204ff6-2404-43a8-a708-a43908501fb9" containerName="istio-proxy"
Sep 15 20:32:44.379011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.378992    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.381580 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.381555    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-a8e967-openshift-default-dockercfg-hkf8l\""
Sep 15 20:32:44.390518 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.390491    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:32:44.409444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409409    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409452    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6b4q\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409575    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409615    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409679    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409734    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409807    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409883    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.409936 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.409915    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511327    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511392    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511468    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511499    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6b4q\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511526    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511567 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511541    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511572    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.511873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511620    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.512004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511877    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.512004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511907    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.512004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.511995    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.512174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.512146    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.512174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.512153    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.514433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.514404    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.514650 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.514629    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.519492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.519459    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.519598 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.519546    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6b4q\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q\") pod \"e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") " pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.690969 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.690871    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:44.971672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.971649    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:32:44.973360 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:32:44.973332    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf60f4898_b711_47a1_a43c_2ac4a8bb3f8b.slice/crio-744f2a9436a39e169f7a7f2a74ced3eda6396b3ee73a879d5a7cff1c3a898c76 WatchSource:0}: Error finding container 744f2a9436a39e169f7a7f2a74ced3eda6396b3ee73a879d5a7cff1c3a898c76: Status 404 returned error can't find the container with id 744f2a9436a39e169f7a7f2a74ced3eda6396b3ee73a879d5a7cff1c3a898c76
Sep 15 20:32:44.975712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.975673    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:32:44.975810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.975763    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:32:44.975875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:44.975808    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:32:45.856634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:45.856594    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerStarted","Data":"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"}
Sep 15 20:32:45.857074 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:45.856649    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerStarted","Data":"744f2a9436a39e169f7a7f2a74ced3eda6396b3ee73a879d5a7cff1c3a898c76"}
Sep 15 20:32:45.880041 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:45.879956    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podStartSLOduration=1.8799337550000002 podStartE2EDuration="1.879933755s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:32:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:32:45.878572639 +0000 UTC m=+1660.323531639" watchObservedRunningTime="2026-09-15 20:32:45.879933755 +0000 UTC m=+1660.324892764"
Sep 15 20:32:46.691424 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:46.691382    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:46.697110 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:46.697083    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:46.861924 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:46.861887    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:46.863010 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:46.862955    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:32:58.736271 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:32:58.736230    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:33:06.252585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:06.252555    2554 scope.go:117] "RemoveContainer" containerID="f687b533737e8688d5a2f88c824d74bccb45181d14556d8f75e27bee35c4ca0e"
Sep 15 20:33:06.261130 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:06.261108    2554 scope.go:117] "RemoveContainer" containerID="88b8de91e3e26c240c5428deef71a332457547436587c68d3cf8e20f3a3928ab"
Sep 15 20:33:25.062090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.062052    2554 generic.go:356] "Generic (PLEG): container finished" podID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerID="7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb" exitCode=0
Sep 15 20:33:25.062621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.062126    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerDied","Data":"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"}
Sep 15 20:33:25.062621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.062579    2554 scope.go:117] "RemoveContainer" containerID="7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"
Sep 15 20:33:25.063825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.063793    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:33:25.063896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.063869    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:33:25.063955 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:25.063901    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:33:26.069648 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:26.069615    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerStarted","Data":"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"}
Sep 15 20:33:26.692088 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:26.692047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:33:26.692346 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:26.692323    2554 patch_prober.go:28] interesting pod/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 20:33:26.692445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:26.692406    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 20:33:27.691900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:27.691859    2554 patch_prober.go:28] interesting pod/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 20:33:27.692331 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:27.691937    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 20:33:28.146216 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.141700    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:33:28.161949 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.161919    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:33:28.162168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.162046    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.165686 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.165654    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-df0188\""
Sep 15 20:33:28.166057 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.166031    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-df0188-dockercfg-bqm9q\""
Sep 15 20:33:28.266808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.266767    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.267099 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.267069    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cs2vx\" (UniqueName: \"kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.368106 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.368059    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.368299 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.368118    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cs2vx\" (UniqueName: \"kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.368851 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.368828    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.376626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.376590    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cs2vx\" (UniqueName: \"kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx\") pod \"payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.474434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.474388    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:28.691817 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.691775    2554 patch_prober.go:28] interesting pod/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 20:33:28.692026 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.691851    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 20:33:28.752997 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:28.752873    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:33:28.758218 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:33:28.758181    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83c66881_93e9_4cab_8ed2_9617e651994b.slice/crio-6c8075c71fbcff8cb75864fa4b1b5b9000be15e212eb7e41eedb691d412eafeb WatchSource:0}: Error finding container 6c8075c71fbcff8cb75864fa4b1b5b9000be15e212eb7e41eedb691d412eafeb: Status 404 returned error can't find the container with id 6c8075c71fbcff8cb75864fa4b1b5b9000be15e212eb7e41eedb691d412eafeb
Sep 15 20:33:29.086582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.086486    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" event={"ID":"83c66881-93e9-4cab-8ed2-9617e651994b","Type":"ContainerStarted","Data":"b181b715a2e8a2e8e0e6cb709ddae369e1efbd5b1aea8f8f9750b81c669a5be3"}
Sep 15 20:33:29.086582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.086538    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" event={"ID":"83c66881-93e9-4cab-8ed2-9617e651994b","Type":"ContainerStarted","Data":"6c8075c71fbcff8cb75864fa4b1b5b9000be15e212eb7e41eedb691d412eafeb"}
Sep 15 20:33:29.086802 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.086689    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:29.102673 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.102620    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" podStartSLOduration=1.102602171 podStartE2EDuration="1.102602171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:33:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:33:29.100945165 +0000 UTC m=+1703.545904174" watchObservedRunningTime="2026-09-15 20:33:29.102602171 +0000 UTC m=+1703.547561178"
Sep 15 20:33:29.692309 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.692269    2554 patch_prober.go:28] interesting pod/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 20:33:29.692693 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:29.692330    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 20:33:30.692173 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:30.692134    2554 patch_prober.go:28] interesting pod/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Sep 15 20:33:30.692437 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:30.692197    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Sep 15 20:33:31.696350 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:31.696318    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:33:31.696721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:31.696605    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:33:31.697356 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:31.697339    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:33:39.927385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:39.927339    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:33:40.093514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:40.093477    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:33:56.655578 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.655536    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"]
Sep 15 20:33:56.659100 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.659082    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:56.661453 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.661415    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:33:56.661610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.661471    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:33:56.665762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.665733    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"]
Sep 15 20:33:56.737113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.737076    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs\" (UID: \"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:56.837805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.837759    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs\" (UID: \"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:56.838468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.838443    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs\" (UID: \"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:56.975075 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:56.975034    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:57.249185 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:57.249153    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"]
Sep 15 20:33:57.251048 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:33:57.251021    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b6be4bd_c7cf_4b15_8b2f_f64b40d306da.slice/crio-f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3 WatchSource:0}: Error finding container f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3: Status 404 returned error can't find the container with id f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3
Sep 15 20:33:58.240353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:58.240312    2554 generic.go:356] "Generic (PLEG): container finished" podID="2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" containerID="d3f84cd0b32750ff3f0abc455bcee14ebe4f2de629a1425290fb09ebf4f85af8" exitCode=0
Sep 15 20:33:58.240807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:58.240403    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs" event={"ID":"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da","Type":"ContainerDied","Data":"d3f84cd0b32750ff3f0abc455bcee14ebe4f2de629a1425290fb09ebf4f85af8"}
Sep 15 20:33:58.240807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:58.240472    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs" event={"ID":"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da","Type":"ContainerStarted","Data":"f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3"}
Sep 15 20:33:59.390503 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:59.390476    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:33:59.472495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:59.472458    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca\") pod \"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da\" (UID: \"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da\") "
Sep 15 20:33:59.472914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:59.472887    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" (UID: "2b6be4bd-c7cf-4b15-8b2f-f64b40d306da"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:33:59.574174 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:33:59.574077    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:00.253372 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:00.253331    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs" event={"ID":"2b6be4bd-c7cf-4b15-8b2f-f64b40d306da","Type":"ContainerDied","Data":"f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3"}
Sep 15 20:34:00.253562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:00.253386    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f85f01d7999ac21f0f2eb3a8abb8816097be1a640e77550c3fd34a6249702af3"
Sep 15 20:34:00.253562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:00.253349    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"
Sep 15 20:34:12.393360 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:12.393322    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"]
Sep 15 20:34:12.398341 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:12.398310    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-a8e967-2k8qs"]
Sep 15 20:34:14.023592 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:14.023554    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" path="/var/lib/kubelet/pods/2b6be4bd-c7cf-4b15-8b2f-f64b40d306da/volumes"
Sep 15 20:34:19.385850 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:19.385816    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:34:19.386350 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:19.386155    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy" containerID="cri-o://f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d" gracePeriod=30
Sep 15 20:34:24.647507 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.647446    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:34:24.726246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726207    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726251    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726276    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726295    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726438    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726496    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6b4q\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726538    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726647 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726598    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:34:24.726810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726719    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726733    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:34:24.726810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726753    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert\") pod \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\" (UID: \"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b\") "
Sep 15 20:34:24.726971 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726823    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:34:24.726971 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.726932    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:34:24.727199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.727177    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.727252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.727203    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.727252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.727218    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.727252 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.727232    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.727348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.727259    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:34:24.728645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.728620    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:34:24.728772 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.728700    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q" (OuterVolumeSpecName: "kube-api-access-v6b4q") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "kube-api-access-v6b4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:34:24.728972 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.728944    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:34:24.729082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.729068    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" (UID: "f60f4898-b711-47a1-a43c-2ac4a8bb3f8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:34:24.828696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.828648    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.828696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.828686    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.828696 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.828698    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.828939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.828708    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:24.828939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:24.828722    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6b4q\" (UniqueName: \"kubernetes.io/projected/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b-kube-api-access-v6b4q\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:25.391928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.391889    2554 generic.go:356] "Generic (PLEG): container finished" podID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerID="f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d" exitCode=0
Sep 15 20:34:25.392119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.391948    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"
Sep 15 20:34:25.392119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.391990    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerDied","Data":"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"}
Sep 15 20:34:25.392119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.392055    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx" event={"ID":"f60f4898-b711-47a1-a43c-2ac4a8bb3f8b","Type":"ContainerDied","Data":"744f2a9436a39e169f7a7f2a74ced3eda6396b3ee73a879d5a7cff1c3a898c76"}
Sep 15 20:34:25.392829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.392083    2554 scope.go:117] "RemoveContainer" containerID="f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"
Sep 15 20:34:25.402956 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.402937    2554 scope.go:117] "RemoveContainer" containerID="7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"
Sep 15 20:34:25.411713 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.411688    2554 scope.go:117] "RemoveContainer" containerID="f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"
Sep 15 20:34:25.412141 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:34:25.412103    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d\": container with ID starting with f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d not found: ID does not exist" containerID="f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"
Sep 15 20:34:25.412234 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.412155    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d"} err="failed to get container status \"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d\": rpc error: code = NotFound desc = could not find container \"f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d\": container with ID starting with f5021c1c56c8d27d5a6c7299c6852ba1d7ea640ca14d2d39960363856c57353d not found: ID does not exist"
Sep 15 20:34:25.412234 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.412174    2554 scope.go:117] "RemoveContainer" containerID="7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"
Sep 15 20:34:25.412518 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:34:25.412494    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb\": container with ID starting with 7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb not found: ID does not exist" containerID="7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"
Sep 15 20:34:25.412580 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.412528    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb"} err="failed to get container status \"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb\": rpc error: code = NotFound desc = could not find container \"7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb\": container with ID starting with 7b475290c6ac92c8954285471e38e2a99521a465194053221129a79feac32efb not found: ID does not exist"
Sep 15 20:34:25.413389 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.413367    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:34:25.416800 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:25.416777    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-a8e967-openshift-default-784979ccd4-fldlx"]
Sep 15 20:34:26.023871 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:26.023829    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" path="/var/lib/kubelet/pods/f60f4898-b711-47a1-a43c-2ac4a8bb3f8b/volumes"
Sep 15 20:34:35.237883 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.237842    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:34:35.293364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.293328    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:34:35.293659 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.293630    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" podUID="83c66881-93e9-4cab-8ed2-9617e651994b" containerName="payload-pre-processing" containerID="cri-o://b181b715a2e8a2e8e0e6cb709ddae369e1efbd5b1aea8f8f9750b81c669a5be3" gracePeriod=30
Sep 15 20:34:35.449379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.449346    2554 generic.go:356] "Generic (PLEG): container finished" podID="83c66881-93e9-4cab-8ed2-9617e651994b" containerID="b181b715a2e8a2e8e0e6cb709ddae369e1efbd5b1aea8f8f9750b81c669a5be3" exitCode=0
Sep 15 20:34:35.449563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.449414    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" event={"ID":"83c66881-93e9-4cab-8ed2-9617e651994b","Type":"ContainerDied","Data":"b181b715a2e8a2e8e0e6cb709ddae369e1efbd5b1aea8f8f9750b81c669a5be3"}
Sep 15 20:34:35.585650 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.585617    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:34:35.634090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.634056    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cs2vx\" (UniqueName: \"kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx\") pod \"83c66881-93e9-4cab-8ed2-9617e651994b\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") "
Sep 15 20:34:35.634287 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.634144    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume\") pod \"83c66881-93e9-4cab-8ed2-9617e651994b\" (UID: \"83c66881-93e9-4cab-8ed2-9617e651994b\") "
Sep 15 20:34:35.634493 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.634466    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "83c66881-93e9-4cab-8ed2-9617e651994b" (UID: "83c66881-93e9-4cab-8ed2-9617e651994b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:34:35.636133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.636111    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx" (OuterVolumeSpecName: "kube-api-access-cs2vx") pod "83c66881-93e9-4cab-8ed2-9617e651994b" (UID: "83c66881-93e9-4cab-8ed2-9617e651994b"). InnerVolumeSpecName "kube-api-access-cs2vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:34:35.734842 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.734800    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cs2vx\" (UniqueName: \"kubernetes.io/projected/83c66881-93e9-4cab-8ed2-9617e651994b-kube-api-access-cs2vx\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:35.734842 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:35.734836    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/83c66881-93e9-4cab-8ed2-9617e651994b-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:36.456552 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:36.456524    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"
Sep 15 20:34:36.456900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:36.456544    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs" event={"ID":"83c66881-93e9-4cab-8ed2-9617e651994b","Type":"ContainerDied","Data":"6c8075c71fbcff8cb75864fa4b1b5b9000be15e212eb7e41eedb691d412eafeb"}
Sep 15 20:34:36.456900 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:36.456639    2554 scope.go:117] "RemoveContainer" containerID="b181b715a2e8a2e8e0e6cb709ddae369e1efbd5b1aea8f8f9750b81c669a5be3"
Sep 15 20:34:36.473684 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:36.473655    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:34:36.476904 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:36.476879    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-df0188-8457bd559d-5z4cs"]
Sep 15 20:34:38.023887 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:38.023848    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83c66881-93e9-4cab-8ed2-9617e651994b" path="/var/lib/kubelet/pods/83c66881-93e9-4cab-8ed2-9617e651994b/volumes"
Sep 15 20:34:42.624854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.624811    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"]
Sep 15 20:34:42.625645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625619    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.625645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625646    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625677    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625687    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625738    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83c66881-93e9-4cab-8ed2-9617e651994b" containerName="payload-pre-processing"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625747    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="83c66881-93e9-4cab-8ed2-9617e651994b" containerName="payload-pre-processing"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625758    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" containerName="revoke-keys"
Sep 15 20:34:42.625816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625768    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" containerName="revoke-keys"
Sep 15 20:34:42.626196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625938    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="83c66881-93e9-4cab-8ed2-9617e651994b" containerName="payload-pre-processing"
Sep 15 20:34:42.626196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625959    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b6be4bd-c7cf-4b15-8b2f-f64b40d306da" containerName="revoke-keys"
Sep 15 20:34:42.626196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.625970    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.626196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.626002    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f60f4898-b711-47a1-a43c-2ac4a8bb3f8b" containerName="istio-proxy"
Sep 15 20:34:42.629938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.629908    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:42.632728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.632526    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:34:42.632876 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.632779    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"]
Sep 15 20:34:42.632953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.632926    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:34:42.706763 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.706719    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t\" (UID: \"3429afde-3d89-4233-bca8-7f95f7355264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:42.808343 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.808301    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t\" (UID: \"3429afde-3d89-4233-bca8-7f95f7355264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:42.809018 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.808957    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t\" (UID: \"3429afde-3d89-4233-bca8-7f95f7355264\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:42.943463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:42.943362    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:43.214364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:43.214332    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"]
Sep 15 20:34:43.216161 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:34:43.216129    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3429afde_3d89_4233_bca8_7f95f7355264.slice/crio-3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1 WatchSource:0}: Error finding container 3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1: Status 404 returned error can't find the container with id 3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1
Sep 15 20:34:43.498408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:43.498311    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t" event={"ID":"3429afde-3d89-4233-bca8-7f95f7355264","Type":"ContainerStarted","Data":"9df59c12b2c6ef7690f39bcade28256071a602a0d22dd745a298b87ff72dd74b"}
Sep 15 20:34:43.498408 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:43.498374    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t" event={"ID":"3429afde-3d89-4233-bca8-7f95f7355264","Type":"ContainerStarted","Data":"3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1"}
Sep 15 20:34:43.513506 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:43.513444    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t" podStartSLOduration=1.5134253279999998 podStartE2EDuration="1.513425328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:34:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:34:43.512842984 +0000 UTC m=+1777.957801993" watchObservedRunningTime="2026-09-15 20:34:43.513425328 +0000 UTC m=+1777.958384335"
Sep 15 20:34:44.505432 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:44.505394    2554 generic.go:356] "Generic (PLEG): container finished" podID="3429afde-3d89-4233-bca8-7f95f7355264" containerID="9df59c12b2c6ef7690f39bcade28256071a602a0d22dd745a298b87ff72dd74b" exitCode=0
Sep 15 20:34:44.505906 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:44.505484    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t" event={"ID":"3429afde-3d89-4233-bca8-7f95f7355264","Type":"ContainerDied","Data":"9df59c12b2c6ef7690f39bcade28256071a602a0d22dd745a298b87ff72dd74b"}
Sep 15 20:34:45.645870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:45.645843    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:45.737941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:45.737906    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca\") pod \"3429afde-3d89-4233-bca8-7f95f7355264\" (UID: \"3429afde-3d89-4233-bca8-7f95f7355264\") "
Sep 15 20:34:45.738326 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:45.738300    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3429afde-3d89-4233-bca8-7f95f7355264" (UID: "3429afde-3d89-4233-bca8-7f95f7355264"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:34:45.839322 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:45.839234    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3429afde-3d89-4233-bca8-7f95f7355264-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:46.516996 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:46.516954    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"
Sep 15 20:34:46.517177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:46.516956    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t" event={"ID":"3429afde-3d89-4233-bca8-7f95f7355264","Type":"ContainerDied","Data":"3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1"}
Sep 15 20:34:46.517177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:46.517086    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3be0b33ac2fe41dc0bced0e31bea045fe11b19caa577fd57b457587b3e2384c1"
Sep 15 20:34:47.473161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:47.473127    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:34:47.482036 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:47.482007    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:34:53.370949 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.370874    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:34:53.372539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.372502    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" podUID="087fe3b8-96f2-4978-ab27-937574b0808d" containerName="payload-processing" containerID="cri-o://6c3234f7c632c47358ead67ceb5cea495d658606a73638b169cd01eeaf23fe6f" gracePeriod=30
Sep 15 20:34:53.375902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.375872    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:34:53.376168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.376137    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" podUID="bcc1d2be-b75e-409f-8266-59d4465bcc12" containerName="payload-pre-processing" containerID="cri-o://eaf1eb2e7feca395710cc8bdf37b95ae2f96ac4148d2d164f4d48a1a0d8d4732" gracePeriod=30
Sep 15 20:34:53.562595 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.562558    2554 generic.go:356] "Generic (PLEG): container finished" podID="087fe3b8-96f2-4978-ab27-937574b0808d" containerID="6c3234f7c632c47358ead67ceb5cea495d658606a73638b169cd01eeaf23fe6f" exitCode=0
Sep 15 20:34:53.562776 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.562734    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" event={"ID":"087fe3b8-96f2-4978-ab27-937574b0808d","Type":"ContainerDied","Data":"6c3234f7c632c47358ead67ceb5cea495d658606a73638b169cd01eeaf23fe6f"}
Sep 15 20:34:53.564778 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.564755    2554 generic.go:356] "Generic (PLEG): container finished" podID="bcc1d2be-b75e-409f-8266-59d4465bcc12" containerID="eaf1eb2e7feca395710cc8bdf37b95ae2f96ac4148d2d164f4d48a1a0d8d4732" exitCode=0
Sep 15 20:34:53.564871 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.564802    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" event={"ID":"bcc1d2be-b75e-409f-8266-59d4465bcc12","Type":"ContainerDied","Data":"eaf1eb2e7feca395710cc8bdf37b95ae2f96ac4148d2d164f4d48a1a0d8d4732"}
Sep 15 20:34:53.665632 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.665599    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:34:53.668549 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.668527    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:34:53.819777 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.819720    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtq77\" (UniqueName: \"kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77\") pod \"bcc1d2be-b75e-409f-8266-59d4465bcc12\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") "
Sep 15 20:34:53.819944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.819830    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume\") pod \"bcc1d2be-b75e-409f-8266-59d4465bcc12\" (UID: \"bcc1d2be-b75e-409f-8266-59d4465bcc12\") "
Sep 15 20:34:53.819944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.819863    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xfc9x\" (UniqueName: \"kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x\") pod \"087fe3b8-96f2-4978-ab27-937574b0808d\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") "
Sep 15 20:34:53.819944 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.819905    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume\") pod \"087fe3b8-96f2-4978-ab27-937574b0808d\" (UID: \"087fe3b8-96f2-4978-ab27-937574b0808d\") "
Sep 15 20:34:53.820275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.820243    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bcc1d2be-b75e-409f-8266-59d4465bcc12" (UID: "bcc1d2be-b75e-409f-8266-59d4465bcc12"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:34:53.820411 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.820303    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "087fe3b8-96f2-4978-ab27-937574b0808d" (UID: "087fe3b8-96f2-4978-ab27-937574b0808d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:34:53.821950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.821927    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x" (OuterVolumeSpecName: "kube-api-access-xfc9x") pod "087fe3b8-96f2-4978-ab27-937574b0808d" (UID: "087fe3b8-96f2-4978-ab27-937574b0808d"). InnerVolumeSpecName "kube-api-access-xfc9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:34:53.821950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.821940    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77" (OuterVolumeSpecName: "kube-api-access-mtq77") pod "bcc1d2be-b75e-409f-8266-59d4465bcc12" (UID: "bcc1d2be-b75e-409f-8266-59d4465bcc12"). InnerVolumeSpecName "kube-api-access-mtq77". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:34:53.921160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.921006    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bcc1d2be-b75e-409f-8266-59d4465bcc12-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:53.921160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.921048    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xfc9x\" (UniqueName: \"kubernetes.io/projected/087fe3b8-96f2-4978-ab27-937574b0808d-kube-api-access-xfc9x\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:53.921160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.921067    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/087fe3b8-96f2-4978-ab27-937574b0808d-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:53.921160 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:53.921080    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtq77\" (UniqueName: \"kubernetes.io/projected/bcc1d2be-b75e-409f-8266-59d4465bcc12-kube-api-access-mtq77\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:34:54.571679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.571649    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"
Sep 15 20:34:54.572133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.571693    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc" event={"ID":"bcc1d2be-b75e-409f-8266-59d4465bcc12","Type":"ContainerDied","Data":"0e509ebce360f6544abd1a834a9592c6b6dcf02a4f6dfe87ea8b5a92214f50db"}
Sep 15 20:34:54.572133 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.571767    2554 scope.go:117] "RemoveContainer" containerID="eaf1eb2e7feca395710cc8bdf37b95ae2f96ac4148d2d164f4d48a1a0d8d4732"
Sep 15 20:34:54.573491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.573465    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr" event={"ID":"087fe3b8-96f2-4978-ab27-937574b0808d","Type":"ContainerDied","Data":"33512182571cedaece2cd63072639136829f45a9c409b0568c3dd50425b2ac86"}
Sep 15 20:34:54.573491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.573489    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"
Sep 15 20:34:54.580793 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.580775    2554 scope.go:117] "RemoveContainer" containerID="6c3234f7c632c47358ead67ceb5cea495d658606a73638b169cd01eeaf23fe6f"
Sep 15 20:34:54.590959 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.590933    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:34:54.592705 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.592686    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-dc12d7-569dfd75b6-6xlrc"]
Sep 15 20:34:54.602214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.602182    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:34:54.605911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:54.605888    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-dc12d7-7d696b674c-2d5cr"]
Sep 15 20:34:56.023560 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:56.023526    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="087fe3b8-96f2-4978-ab27-937574b0808d" path="/var/lib/kubelet/pods/087fe3b8-96f2-4978-ab27-937574b0808d/volumes"
Sep 15 20:34:56.023974 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:56.023918    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcc1d2be-b75e-409f-8266-59d4465bcc12" path="/var/lib/kubelet/pods/bcc1d2be-b75e-409f-8266-59d4465bcc12/volumes"
Sep 15 20:34:57.894373 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:57.894337    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"]
Sep 15 20:34:57.897204 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:57.897174    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-7e3543-ptp4t"]
Sep 15 20:34:58.023467 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:34:58.023427    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3429afde-3d89-4233-bca8-7f95f7355264" path="/var/lib/kubelet/pods/3429afde-3d89-4233-bca8-7f95f7355264/volumes"
Sep 15 20:35:00.747020 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:00.746976    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:35:00.747490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:00.747202    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" containerID="cri-o://6c145a916c51b381a75ca5a50e2db1b09b9cbbd656075b6781c5ceb1191554ca" gracePeriod=30
Sep 15 20:35:01.220597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220565    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"]
Sep 15 20:35:01.220916 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220904    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="087fe3b8-96f2-4978-ab27-937574b0808d" containerName="payload-processing"
Sep 15 20:35:01.220958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220918    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="087fe3b8-96f2-4978-ab27-937574b0808d" containerName="payload-processing"
Sep 15 20:35:01.220958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220927    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcc1d2be-b75e-409f-8266-59d4465bcc12" containerName="payload-pre-processing"
Sep 15 20:35:01.220958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220932    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcc1d2be-b75e-409f-8266-59d4465bcc12" containerName="payload-pre-processing"
Sep 15 20:35:01.220958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220949    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3429afde-3d89-4233-bca8-7f95f7355264" containerName="revoke-keys"
Sep 15 20:35:01.220958 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.220956    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3429afde-3d89-4233-bca8-7f95f7355264" containerName="revoke-keys"
Sep 15 20:35:01.221155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.221031    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3429afde-3d89-4233-bca8-7f95f7355264" containerName="revoke-keys"
Sep 15 20:35:01.221155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.221041    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="087fe3b8-96f2-4978-ab27-937574b0808d" containerName="payload-processing"
Sep 15 20:35:01.221155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.221048    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcc1d2be-b75e-409f-8266-59d4465bcc12" containerName="payload-pre-processing"
Sep 15 20:35:01.225550 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.225526    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:01.228161 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.228138    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:35:01.228293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.228140    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:35:01.232456 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.232432    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"]
Sep 15 20:35:01.297693 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.297648    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k\" (UID: \"3e26331c-8ee6-4dff-b291-539bab558572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:01.398499 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.398458    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k\" (UID: \"3e26331c-8ee6-4dff-b291-539bab558572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:01.399113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.399094    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k\" (UID: \"3e26331c-8ee6-4dff-b291-539bab558572\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:01.538403 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.538307    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:01.822187 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:01.822162    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"]
Sep 15 20:35:01.823752 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:35:01.823719    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e26331c_8ee6_4dff_b291_539bab558572.slice/crio-3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf WatchSource:0}: Error finding container 3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf: Status 404 returned error can't find the container with id 3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf
Sep 15 20:35:02.493620 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.493579    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" podUID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" containerName="main" containerID="cri-o://bdb67ebff0d9e59e4fc7d262e676ec10fba638ceba7a4bad8e5e14dd4f16664b" gracePeriod=45
Sep 15 20:35:02.500625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.500583    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" podUID="27800a24-96b4-4289-b141-93b27bf5cf0b" containerName="main" containerID="cri-o://03f2549d3734cd485cb6fa93b63af75404b98ac342d1de86b068d1f5ac021245" gracePeriod=45
Sep 15 20:35:02.619796 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.619756    2554 generic.go:356] "Generic (PLEG): container finished" podID="3e26331c-8ee6-4dff-b291-539bab558572" containerID="5a365b23e852e6d9c7a15efd184311b210a91f98ee97ae0de62241f564be7360" exitCode=0
Sep 15 20:35:02.619918 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.619797    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k" event={"ID":"3e26331c-8ee6-4dff-b291-539bab558572","Type":"ContainerDied","Data":"5a365b23e852e6d9c7a15efd184311b210a91f98ee97ae0de62241f564be7360"}
Sep 15 20:35:02.619918 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.619861    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k" event={"ID":"3e26331c-8ee6-4dff-b291-539bab558572","Type":"ContainerStarted","Data":"3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf"}
Sep 15 20:35:02.621678 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.621657    2554 generic.go:356] "Generic (PLEG): container finished" podID="27800a24-96b4-4289-b141-93b27bf5cf0b" containerID="03f2549d3734cd485cb6fa93b63af75404b98ac342d1de86b068d1f5ac021245" exitCode=0
Sep 15 20:35:02.621774 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.621729    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" event={"ID":"27800a24-96b4-4289-b141-93b27bf5cf0b","Type":"ContainerDied","Data":"03f2549d3734cd485cb6fa93b63af75404b98ac342d1de86b068d1f5ac021245"}
Sep 15 20:35:02.623613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.623587    2554 generic.go:356] "Generic (PLEG): container finished" podID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" containerID="bdb67ebff0d9e59e4fc7d262e676ec10fba638ceba7a4bad8e5e14dd4f16664b" exitCode=0
Sep 15 20:35:02.623735 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.623676    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" event={"ID":"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f","Type":"ContainerDied","Data":"bdb67ebff0d9e59e4fc7d262e676ec10fba638ceba7a4bad8e5e14dd4f16664b"}
Sep 15 20:35:02.752218 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.752143    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:35:02.802868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.802833    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:35:02.811614 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811585    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.811782 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811713    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.811782 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811741    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.811903 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811780    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.811903 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811836    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgg87\" (UniqueName: \"kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.811903 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811871    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs\") pod \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\" (UID: \"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f\") "
Sep 15 20:35:02.812071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.811911    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.812172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.812148    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home" (OuterVolumeSpecName: "home") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.812256 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.812205    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.812373 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.812349    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache" (OuterVolumeSpecName: "model-cache") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.814336 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.814312    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm" (OuterVolumeSpecName: "dshm") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.814465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.814350    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87" (OuterVolumeSpecName: "kube-api-access-mgg87") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "kube-api-access-mgg87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:02.814544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.814522    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" (UID: "d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:35:02.913384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913342    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913395    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913477    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913512    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5zp7\" (UniqueName: \"kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913532    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913580    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs\") pod \"27800a24-96b4-4289-b141-93b27bf5cf0b\" (UID: \"27800a24-96b4-4289-b141-93b27bf5cf0b\") "
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913656    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache" (OuterVolumeSpecName: "model-cache") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913712    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.913846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913795    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home" (OuterVolumeSpecName: "home") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913940    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913959    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.913974    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgg87\" (UniqueName: \"kubernetes.io/projected/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-kube-api-access-mgg87\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.914021    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.914035    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.914047    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.914074    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.914254 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.914088    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:02.915705 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.915684    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm" (OuterVolumeSpecName: "dshm") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:02.915809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.915788    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:35:02.915845 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:02.915809    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7" (OuterVolumeSpecName: "kube-api-access-r5zp7") pod "27800a24-96b4-4289-b141-93b27bf5cf0b" (UID: "27800a24-96b4-4289-b141-93b27bf5cf0b"). InnerVolumeSpecName "kube-api-access-r5zp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:03.015278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.015184    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27800a24-96b4-4289-b141-93b27bf5cf0b-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:03.015278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.015219    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5zp7\" (UniqueName: \"kubernetes.io/projected/27800a24-96b4-4289-b141-93b27bf5cf0b-kube-api-access-r5zp7\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:03.015278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.015230    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27800a24-96b4-4289-b141-93b27bf5cf0b-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:03.630629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.630593    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"
Sep 15 20:35:03.630811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.630624    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv" event={"ID":"d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f","Type":"ContainerDied","Data":"7b169936851b532a01072caa888bf7bc1baea19a297c6796ee7edc9633f665ab"}
Sep 15 20:35:03.630811 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.630687    2554 scope.go:117] "RemoveContainer" containerID="bdb67ebff0d9e59e4fc7d262e676ec10fba638ceba7a4bad8e5e14dd4f16664b"
Sep 15 20:35:03.632235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.632214    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"
Sep 15 20:35:03.632325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.632210    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r" event={"ID":"27800a24-96b4-4289-b141-93b27bf5cf0b","Type":"ContainerDied","Data":"5590dc53a6af855100d86621880f44ad00e2f0d53234119e8a35ab788b48a3e8"}
Sep 15 20:35:03.640851 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.640747    2554 scope.go:117] "RemoveContainer" containerID="03f2549d3734cd485cb6fa93b63af75404b98ac342d1de86b068d1f5ac021245"
Sep 15 20:35:03.666007 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.664735    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:35:03.672371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.672332    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/premium-w0-7e3543-kserve-74d5546bbc-5kr2r"]
Sep 15 20:35:03.682235 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.682195    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:35:03.686911 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.686866    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-7e3543/embedding-w0-7e3543-kserve-678bf596cf-p7cgv"]
Sep 15 20:35:03.786728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.786700    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:03.824156 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.824064    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca\") pod \"3e26331c-8ee6-4dff-b291-539bab558572\" (UID: \"3e26331c-8ee6-4dff-b291-539bab558572\") "
Sep 15 20:35:03.824535 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.824506    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e26331c-8ee6-4dff-b291-539bab558572" (UID: "3e26331c-8ee6-4dff-b291-539bab558572"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:35:03.925344 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:03.925309    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e26331c-8ee6-4dff-b291-539bab558572-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:04.024585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.024550    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27800a24-96b4-4289-b141-93b27bf5cf0b" path="/var/lib/kubelet/pods/27800a24-96b4-4289-b141-93b27bf5cf0b/volumes"
Sep 15 20:35:04.025090 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.025069    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" path="/var/lib/kubelet/pods/d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f/volumes"
Sep 15 20:35:04.639201 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.639167    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"
Sep 15 20:35:04.639353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.639206    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k" event={"ID":"3e26331c-8ee6-4dff-b291-539bab558572","Type":"ContainerDied","Data":"3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf"}
Sep 15 20:35:04.639353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.639258    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f4cb0f5d5b62074efe1e30c8f46a89e1ee96857e974373f6d9bcc6ce0085edf"
Sep 15 20:35:04.968828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.968792    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:35:04.969310 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:04.969022    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy" containerID="cri-o://077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6" gracePeriod=30
Sep 15 20:35:05.321487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:05.321376    2554 patch_prober.go:28] interesting pod/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 20:35:05.321487 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:05.321447    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 20:35:05.999373 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:05.999343    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:35:06.044610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044520    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.044610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044561    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.044840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044609    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.044840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044647    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.044840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044674    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.045045 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044931    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:35:06.045045 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.044931    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data" (OuterVolumeSpecName: "istio-data") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:06.045165 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045065    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.045227 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.045313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045294    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8j94\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.045378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045345    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs\") pod \"1bfccabb-d5da-4e7d-a77f-102141d70592\" (UID: \"1bfccabb-d5da-4e7d-a77f-102141d70592\") "
Sep 15 20:35:06.045634 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045553    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:06.045758 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045671    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:06.046010 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.045942    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:06.046325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.046095    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.046325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.046117    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.046325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.046132    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.046325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.046145    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.046325 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.046160    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1bfccabb-d5da-4e7d-a77f-102141d70592-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.047659 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.047602    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token" (OuterVolumeSpecName: "istio-token") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:06.047872 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.047838    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:06.048077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.048052    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:35:06.048175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.048074    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94" (OuterVolumeSpecName: "kube-api-access-l8j94") pod "1bfccabb-d5da-4e7d-a77f-102141d70592" (UID: "1bfccabb-d5da-4e7d-a77f-102141d70592"). InnerVolumeSpecName "kube-api-access-l8j94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:06.146710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.146670    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8j94\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-kube-api-access-l8j94\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.146710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.146703    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.146710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.146712    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.146710 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.146720    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1bfccabb-d5da-4e7d-a77f-102141d70592-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:06.291447 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.291414    2554 scope.go:117] "RemoveContainer" containerID="644f9dbec9bdf02df009f552d72c2f9cdefa4e3c398ff61fd67c8f90b9280f52"
Sep 15 20:35:06.300348 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.300320    2554 scope.go:117] "RemoveContainer" containerID="6e19c40475082cf02e4b84d902aa0a3a7f58cde561f009b2257ef8adc0cdba5c"
Sep 15 20:35:06.309182 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.309161    2554 scope.go:117] "RemoveContainer" containerID="6c145a916c51b381a75ca5a50e2db1b09b9cbbd656075b6781c5ceb1191554ca"
Sep 15 20:35:06.650936 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.650837    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerDied","Data":"6c145a916c51b381a75ca5a50e2db1b09b9cbbd656075b6781c5ceb1191554ca"}
Sep 15 20:35:06.650936 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.650892    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"
Sep 15 20:35:06.650936 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.650903    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk" event={"ID":"1bfccabb-d5da-4e7d-a77f-102141d70592","Type":"ContainerDied","Data":"d896c7041a797376854b57d608676ac564da7eef07c43ecb006765e54b466e80"}
Sep 15 20:35:06.681875 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.681826    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:35:06.688935 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:06.688898    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-dc12d7-openshift-default-88cfc7d44-nzfbk"]
Sep 15 20:35:08.023617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:08.023580    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" path="/var/lib/kubelet/pods/1bfccabb-d5da-4e7d-a77f-102141d70592/volumes"
Sep 15 20:35:10.216833 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.216809    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:35:10.286149 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286049    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286149 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286090    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286149 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286118    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286161    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-89n9s\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286232    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286281    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286307    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286356    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286371    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286403    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data\") pod \"79ba6cf1-3be4-40e8-b660-816837572f06\" (UID: \"79ba6cf1-3be4-40e8-b660-816837572f06\") "
Sep 15 20:35:10.286421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286409    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:10.286828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286701    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data" (OuterVolumeSpecName: "istio-data") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:10.286828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286734    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:35:10.286828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286752    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.286828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286765    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.287066 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.286894    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:10.288572 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.288546    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s" (OuterVolumeSpecName: "kube-api-access-89n9s") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "kube-api-access-89n9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:10.288680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.288575    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token" (OuterVolumeSpecName: "istio-token") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:10.288680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.288615    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:10.288680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.288636    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "79ba6cf1-3be4-40e8-b660-816837572f06" (UID: "79ba6cf1-3be4-40e8-b660-816837572f06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:35:10.387718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387682    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.387718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387711    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.387718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387720    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79ba6cf1-3be4-40e8-b660-816837572f06-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.387718 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387729    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-89n9s\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-kube-api-access-89n9s\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.388021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387740    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79ba6cf1-3be4-40e8-b660-816837572f06-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.388021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387750    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79ba6cf1-3be4-40e8-b660-816837572f06-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.388021 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.387758    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79ba6cf1-3be4-40e8-b660-816837572f06-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:10.672034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.671937    2554 generic.go:356] "Generic (PLEG): container finished" podID="79ba6cf1-3be4-40e8-b660-816837572f06" containerID="077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6" exitCode=0
Sep 15 20:35:10.672034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.672021    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"
Sep 15 20:35:10.672034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.672021    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerDied","Data":"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"}
Sep 15 20:35:10.672237 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.672086    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp" event={"ID":"79ba6cf1-3be4-40e8-b660-816837572f06","Type":"ContainerDied","Data":"0df7f9fc988cd0e1b447a18716bd3fcc84f0a718c5775d398a1235c0eff2dcd7"}
Sep 15 20:35:10.672237 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.672120    2554 scope.go:117] "RemoveContainer" containerID="077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"
Sep 15 20:35:10.680920 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.680900    2554 scope.go:117] "RemoveContainer" containerID="0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"
Sep 15 20:35:10.689333 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.689313    2554 scope.go:117] "RemoveContainer" containerID="077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"
Sep 15 20:35:10.689650 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:35:10.689627    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6\": container with ID starting with 077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6 not found: ID does not exist" containerID="077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"
Sep 15 20:35:10.689712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.689661    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6"} err="failed to get container status \"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6\": rpc error: code = NotFound desc = could not find container \"077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6\": container with ID starting with 077fd9e351e75368b4dc7599472e212ab6f7fd20850e81d7b03d4aac94c424d6 not found: ID does not exist"
Sep 15 20:35:10.689712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.689679    2554 scope.go:117] "RemoveContainer" containerID="0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"
Sep 15 20:35:10.689951 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:35:10.689930    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d\": container with ID starting with 0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d not found: ID does not exist" containerID="0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"
Sep 15 20:35:10.690079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.689956    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d"} err="failed to get container status \"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d\": rpc error: code = NotFound desc = could not find container \"0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d\": container with ID starting with 0e13a7638c1bdf078791888cee46555ce0f7da0a26aa9aeb9a1a0674c5e75b4d not found: ID does not exist"
Sep 15 20:35:10.693564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.693540    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:35:10.698565 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:10.698540    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-7e3543-openshift-default-5bd674bf4-f9xqp"]
Sep 15 20:35:11.903724 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:11.903686    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:35:11.904251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:11.903939    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" podUID="973171a0-81c5-4b9d-a246-165678e76076" containerName="payload-processing" containerID="cri-o://8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1" gracePeriod=30
Sep 15 20:35:12.024250 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.023827    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" path="/var/lib/kubelet/pods/79ba6cf1-3be4-40e8-b660-816837572f06/volumes"
Sep 15 20:35:12.056690 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.056651    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"]
Sep 15 20:35:12.059077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.059051    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f49968-s484k"]
Sep 15 20:35:12.173495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.173462    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:35:12.307402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.307365    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume\") pod \"973171a0-81c5-4b9d-a246-165678e76076\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") "
Sep 15 20:35:12.307605 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.307426    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csx8k\" (UniqueName: \"kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k\") pod \"973171a0-81c5-4b9d-a246-165678e76076\" (UID: \"973171a0-81c5-4b9d-a246-165678e76076\") "
Sep 15 20:35:12.307855 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.307823    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "973171a0-81c5-4b9d-a246-165678e76076" (UID: "973171a0-81c5-4b9d-a246-165678e76076"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:35:12.309542 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.309516    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k" (OuterVolumeSpecName: "kube-api-access-csx8k") pod "973171a0-81c5-4b9d-a246-165678e76076" (UID: "973171a0-81c5-4b9d-a246-165678e76076"). InnerVolumeSpecName "kube-api-access-csx8k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:12.408350 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.408254    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csx8k\" (UniqueName: \"kubernetes.io/projected/973171a0-81c5-4b9d-a246-165678e76076-kube-api-access-csx8k\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:12.408350 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.408287    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/973171a0-81c5-4b9d-a246-165678e76076-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:12.684619 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.684524    2554 generic.go:356] "Generic (PLEG): container finished" podID="973171a0-81c5-4b9d-a246-165678e76076" containerID="8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1" exitCode=0
Sep 15 20:35:12.684619 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.684570    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"
Sep 15 20:35:12.684619 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.684609    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" event={"ID":"973171a0-81c5-4b9d-a246-165678e76076","Type":"ContainerDied","Data":"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"}
Sep 15 20:35:12.684882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.684666    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6" event={"ID":"973171a0-81c5-4b9d-a246-165678e76076","Type":"ContainerDied","Data":"c3754aa558daed22ec2d227aedb479299a825115c20aa586705bd85d0967c004"}
Sep 15 20:35:12.684882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.684698    2554 scope.go:117] "RemoveContainer" containerID="8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"
Sep 15 20:35:12.694004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.693970    2554 scope.go:117] "RemoveContainer" containerID="8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"
Sep 15 20:35:12.694303 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:35:12.694279    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1\": container with ID starting with 8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1 not found: ID does not exist" containerID="8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"
Sep 15 20:35:12.694378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.694311    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1"} err="failed to get container status \"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1\": rpc error: code = NotFound desc = could not find container \"8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1\": container with ID starting with 8536cc3c745c5904dacb2a099dff0df18741777031875bfdde97b2004ccdbca1 not found: ID does not exist"
Sep 15 20:35:12.705832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.705801    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:35:12.710037 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:12.710009    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f49968-fc685df7f-8t7q6"]
Sep 15 20:35:14.023604 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:14.023571    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e26331c-8ee6-4dff-b291-539bab558572" path="/var/lib/kubelet/pods/3e26331c-8ee6-4dff-b291-539bab558572/volumes"
Sep 15 20:35:14.024093 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:14.023934    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="973171a0-81c5-4b9d-a246-165678e76076" path="/var/lib/kubelet/pods/973171a0-81c5-4b9d-a246-165678e76076/volumes"
Sep 15 20:35:15.229765 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:15.229723    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:35:18.373034 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:18.372999    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:35:18.373480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:18.373214    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy" containerID="cri-o://d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e" gracePeriod=30
Sep 15 20:35:23.635167 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.635141    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:35:23.714893 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.714859    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.714919    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.714965    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715021    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715108 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715051    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715118    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715161    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715235    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data" (OuterVolumeSpecName: "istio-data") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:23.715342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715302    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bq4cf\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715421    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:23.715557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715452    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:23.715557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715511    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket\") pod \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\" (UID: \"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0\") "
Sep 15 20:35:23.715557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715540    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:35:23.715782 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715758    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:23.715840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715816    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.715840 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715835    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.715950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715849    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.715950 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.715857    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.717380 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.717358    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token" (OuterVolumeSpecName: "istio-token") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:23.717380 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.717368    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:35:23.717657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.717638    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:35:23.717740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.717657    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf" (OuterVolumeSpecName: "kube-api-access-bq4cf") pod "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" (UID: "edb47852-cb53-4faf-a34e-3ed5d9ac2ae0"). InnerVolumeSpecName "kube-api-access-bq4cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:35:23.743138 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.743103    2554 generic.go:356] "Generic (PLEG): container finished" podID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerID="d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e" exitCode=0
Sep 15 20:35:23.743313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.743153    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"
Sep 15 20:35:23.743313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.743178    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerDied","Data":"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"}
Sep 15 20:35:23.743313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.743229    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr" event={"ID":"edb47852-cb53-4faf-a34e-3ed5d9ac2ae0","Type":"ContainerDied","Data":"ba52223f78c963670fc8cea8fa6de15a991995546e8e6264630915d00bd5bdd0"}
Sep 15 20:35:23.743313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.743251    2554 scope.go:117] "RemoveContainer" containerID="d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"
Sep 15 20:35:23.755379 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.755341    2554 scope.go:117] "RemoveContainer" containerID="dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"
Sep 15 20:35:23.764324 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.764300    2554 scope.go:117] "RemoveContainer" containerID="d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"
Sep 15 20:35:23.764628 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:35:23.764607    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e\": container with ID starting with d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e not found: ID does not exist" containerID="d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"
Sep 15 20:35:23.764674 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.764637    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e"} err="failed to get container status \"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e\": rpc error: code = NotFound desc = could not find container \"d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e\": container with ID starting with d0acad726a2b477f82630f4555dc74be6ecf91a048465ccbba6818af8856a08e not found: ID does not exist"
Sep 15 20:35:23.764674 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.764656    2554 scope.go:117] "RemoveContainer" containerID="dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"
Sep 15 20:35:23.764922 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:35:23.764906    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010\": container with ID starting with dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010 not found: ID does not exist" containerID="dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"
Sep 15 20:35:23.764993 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.764926    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010"} err="failed to get container status \"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010\": rpc error: code = NotFound desc = could not find container \"dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010\": container with ID starting with dcb6ce09f242b6d107bfa1223bff41d6871fdf83147c3649972622df90378010 not found: ID does not exist"
Sep 15 20:35:23.768761 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.768727    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:35:23.771784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.771757    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-f49968-openshift-default-6df87976d-wj6dr"]
Sep 15 20:35:23.817139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.817100    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bq4cf\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-kube-api-access-bq4cf\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.817139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.817133    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.817139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.817145    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.817375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.817154    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:23.817375 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:23.817165    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:35:24.023269 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:24.023186    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" path="/var/lib/kubelet/pods/edb47852-cb53-4faf-a34e-3ed5d9ac2ae0/volumes"
Sep 15 20:35:44.433672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:35:44.433635    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:36:01.709817 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:01.709783    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:36:06.224270 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.224231    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:36:06.354076 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.354045    2554 scope.go:117] "RemoveContainer" containerID="6e4a2c750ab023d9839e5e56025f0e460f52324682b6b51cb5a2f14891aee01e"
Sep 15 20:36:06.633336 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633258    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:36:06.633612 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633598    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:06.633661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633614    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:06.633661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633628    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973171a0-81c5-4b9d-a246-165678e76076" containerName="payload-processing"
Sep 15 20:36:06.633661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633638    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="973171a0-81c5-4b9d-a246-165678e76076" containerName="payload-processing"
Sep 15 20:36:06.633661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633649    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27800a24-96b4-4289-b141-93b27bf5cf0b" containerName="main"
Sep 15 20:36:06.633661 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633655    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="27800a24-96b4-4289-b141-93b27bf5cf0b" containerName="main"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633665    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633671    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633678    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633686    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633697    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633703    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633710    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633715    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633725    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633729    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633737    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e26331c-8ee6-4dff-b291-539bab558572" containerName="revoke-keys"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633742    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e26331c-8ee6-4dff-b291-539bab558572" containerName="revoke-keys"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633749    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" containerName="main"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633754    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" containerName="main"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633815    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.633820 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633824    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633831    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="27800a24-96b4-4289-b141-93b27bf5cf0b" containerName="main"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633836    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633845    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="79ba6cf1-3be4-40e8-b660-816837572f06" containerName="istio-proxy"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633853    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="edb47852-cb53-4faf-a34e-3ed5d9ac2ae0" containerName="istio-proxy"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633858    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="973171a0-81c5-4b9d-a246-165678e76076" containerName="payload-processing"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633863    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e26331c-8ee6-4dff-b291-539bab558572" containerName="revoke-keys"
Sep 15 20:36:06.634498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.633870    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8c8b0c5-d60e-4a00-8f27-56d0bc8ac53f" containerName="main"
Sep 15 20:36:06.638238 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.638220    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.640456 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.640406    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-92702a\"/\"default-dockercfg-fcw5j\""
Sep 15 20:36:06.640663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.640646    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-92702a\"/\"openshift-service-ca.crt\""
Sep 15 20:36:06.641398 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.641379    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-92702a\"/\"kube-root-ca.crt\""
Sep 15 20:36:06.641728 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.641713    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-92702a\"/\"sub-test-model-92702a-kserve-self-signed-certs\""
Sep 15 20:36:06.645624 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.645598    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:36:06.793071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793032    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p524v\" (UniqueName: \"kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.793071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793072    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.793328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793097    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.793328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793123    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.793328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793178    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.793328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.793210    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894579    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894620    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894679 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894676    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p524v\" (UniqueName: \"kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894697    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894716    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.894977 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.894733    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.895171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.895118    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.895219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.895160    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.895219 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.895177    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.897059 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.897028    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.897257 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.897237    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.901769 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.901747    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p524v\" (UniqueName: \"kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v\") pod \"sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") " pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:06.950301 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:06.950253    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:07.219769 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:07.219741    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:36:07.221948 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:36:07.221916    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27740de3_4151_4cf7_8588_11dec1edaee6.slice/crio-1ecebd082b649666979ba473304c98beb4140cedd3205f0868eecd41ca1c2c3d WatchSource:0}: Error finding container 1ecebd082b649666979ba473304c98beb4140cedd3205f0868eecd41ca1c2c3d: Status 404 returned error can't find the container with id 1ecebd082b649666979ba473304c98beb4140cedd3205f0868eecd41ca1c2c3d
Sep 15 20:36:07.964873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:07.964835    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" event={"ID":"27740de3-4151-4cf7-8588-11dec1edaee6","Type":"ContainerStarted","Data":"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"}
Sep 15 20:36:07.964873 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:07.964881    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" event={"ID":"27740de3-4151-4cf7-8588-11dec1edaee6","Type":"ContainerStarted","Data":"1ecebd082b649666979ba473304c98beb4140cedd3205f0868eecd41ca1c2c3d"}
Sep 15 20:36:07.982184 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:07.982129    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" podStartSLOduration=1.982111669 podStartE2EDuration="1.982111669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:36:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:36:07.981184416 +0000 UTC m=+1862.426143436" watchObservedRunningTime="2026-09-15 20:36:07.982111669 +0000 UTC m=+1862.427070677"
Sep 15 20:36:13.786629 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.786590    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"]
Sep 15 20:36:13.787085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.786967    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bfccabb-d5da-4e7d-a77f-102141d70592" containerName="istio-proxy"
Sep 15 20:36:13.789796 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.789779    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:13.792460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.792436    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-r5lpt\""
Sep 15 20:36:13.792460 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.792448    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:36:13.796667 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.796638    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"]
Sep 15 20:36:13.956178 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:13.956132    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb\" (UID: \"0f1a7d76-3140-4b8b-b79a-cd32f12927d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:14.057244 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.057144    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb\" (UID: \"0f1a7d76-3140-4b8b-b79a-cd32f12927d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:14.057809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.057786    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb\" (UID: \"0f1a7d76-3140-4b8b-b79a-cd32f12927d6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:14.102745 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.102706    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:14.372101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.372075    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"]
Sep 15 20:36:14.374908 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:36:14.374879    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f1a7d76_3140_4b8b_b79a_cd32f12927d6.slice/crio-0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507 WatchSource:0}: Error finding container 0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507: Status 404 returned error can't find the container with id 0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507
Sep 15 20:36:14.999778 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.999746    2554 generic.go:356] "Generic (PLEG): container finished" podID="0f1a7d76-3140-4b8b-b79a-cd32f12927d6" containerID="e62aaf52d98eb703a8855abc4e293ff97d4924c2bc6fce23b245564897c03ed7" exitCode=0
Sep 15 20:36:15.000165 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.999817    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb" event={"ID":"0f1a7d76-3140-4b8b-b79a-cd32f12927d6","Type":"ContainerDied","Data":"e62aaf52d98eb703a8855abc4e293ff97d4924c2bc6fce23b245564897c03ed7"}
Sep 15 20:36:15.000165 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:14.999856    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb" event={"ID":"0f1a7d76-3140-4b8b-b79a-cd32f12927d6","Type":"ContainerStarted","Data":"0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507"}
Sep 15 20:36:16.134914 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.134888    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:16.278815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.278715    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca\") pod \"0f1a7d76-3140-4b8b-b79a-cd32f12927d6\" (UID: \"0f1a7d76-3140-4b8b-b79a-cd32f12927d6\") "
Sep 15 20:36:16.279118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.279092    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0f1a7d76-3140-4b8b-b79a-cd32f12927d6" (UID: "0f1a7d76-3140-4b8b-b79a-cd32f12927d6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:36:16.379722 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.379682    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f1a7d76-3140-4b8b-b79a-cd32f12927d6-maas-api-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:16.728888 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.728814    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" podUID="e57749f7-23cc-4124-8ca6-d02a447487d8" containerName="main" containerID="cri-o://80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e" gracePeriod=45
Sep 15 20:36:16.950954 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.950920    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:16.951139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.950996    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:16.964928 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.964841    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:16.980113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:16.980040    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:36:17.012176 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.012145    2554 generic.go:356] "Generic (PLEG): container finished" podID="e57749f7-23cc-4124-8ca6-d02a447487d8" containerID="80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e" exitCode=0
Sep 15 20:36:17.012386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.012207    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"
Sep 15 20:36:17.012386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.012232    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" event={"ID":"e57749f7-23cc-4124-8ca6-d02a447487d8","Type":"ContainerDied","Data":"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"}
Sep 15 20:36:17.012386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.012287    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb" event={"ID":"e57749f7-23cc-4124-8ca6-d02a447487d8","Type":"ContainerDied","Data":"143d7f613e85a821165870a9ddd4f1184f4e5edc6b4353fc6529318f2211f7d8"}
Sep 15 20:36:17.012386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.012311    2554 scope.go:117] "RemoveContainer" containerID="80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"
Sep 15 20:36:17.013822 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.013804    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"
Sep 15 20:36:17.013951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.013806    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb" event={"ID":"0f1a7d76-3140-4b8b-b79a-cd32f12927d6","Type":"ContainerDied","Data":"0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507"}
Sep 15 20:36:17.014087 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.013973    2554 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0d86be21e01a689cdf8f7c3cb01439e010353bedd4d60bbad597967d861c5507"
Sep 15 20:36:17.022957 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.022930    2554 scope.go:117] "RemoveContainer" containerID="80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"
Sep 15 20:36:17.023372 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:36:17.023352    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e\": container with ID starting with 80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e not found: ID does not exist" containerID="80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"
Sep 15 20:36:17.023489 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.023380    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e"} err="failed to get container status \"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e\": rpc error: code = NotFound desc = could not find container \"80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e\": container with ID starting with 80a6cdc89f4e57adab1349ab3357ecdf01a349c330f26994d0ec611380de446e not found: ID does not exist"
Sep 15 20:36:17.028809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.028779    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:36:17.084839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.084807    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.084839 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.084847    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.085121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.084880    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nt29k\" (UniqueName: \"kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.085121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.084953    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.085121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085011    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.085121 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085102    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache\") pod \"e57749f7-23cc-4124-8ca6-d02a447487d8\" (UID: \"e57749f7-23cc-4124-8ca6-d02a447487d8\") "
Sep 15 20:36:17.085345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085129    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:17.085345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085262    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home" (OuterVolumeSpecName: "home") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:17.085451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085372    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache" (OuterVolumeSpecName: "model-cache") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:17.085509 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085483    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.085509 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085502    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.085621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.085523    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.087196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.087168    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:36:17.087344 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.087271    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k" (OuterVolumeSpecName: "kube-api-access-nt29k") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "kube-api-access-nt29k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:36:17.087466 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.087449    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm" (OuterVolumeSpecName: "dshm") pod "e57749f7-23cc-4124-8ca6-d02a447487d8" (UID: "e57749f7-23cc-4124-8ca6-d02a447487d8"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:17.186291 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.186257    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e57749f7-23cc-4124-8ca6-d02a447487d8-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.186291 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.186287    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nt29k\" (UniqueName: \"kubernetes.io/projected/e57749f7-23cc-4124-8ca6-d02a447487d8-kube-api-access-nt29k\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.186291 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.186297    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e57749f7-23cc-4124-8ca6-d02a447487d8-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:17.343475 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.343438    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:36:17.350071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:17.350039    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/auth-test-model-e80b38-kserve-7ddcb6f87f-hnrlb"]
Sep 15 20:36:18.028672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:18.028633    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e57749f7-23cc-4124-8ca6-d02a447487d8" path="/var/lib/kubelet/pods/e57749f7-23cc-4124-8ca6-d02a447487d8/volumes"
Sep 15 20:36:18.671052 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:18.671010    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:36:25.823756 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:25.823713    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:36:29.566164 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:29.566071    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"]
Sep 15 20:36:29.569082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:29.569054    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-725e67-2d8xb"]
Sep 15 20:36:30.023291 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:30.023254    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f1a7d76-3140-4b8b-b79a-cd32f12927d6" path="/var/lib/kubelet/pods/0f1a7d76-3140-4b8b-b79a-cd32f12927d6/volumes"
Sep 15 20:36:33.690244 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:33.690197    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" podUID="9480e89b-4c84-4295-96c9-35a9913299d3" containerName="main" containerID="cri-o://99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5" gracePeriod=45
Sep 15 20:36:33.941816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:33.941747    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:36:34.027912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.027884    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.027912 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.027922    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.028177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.027968    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klhl4\" (UniqueName: \"kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.028177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028065    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.028177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028106    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.028177 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028142    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm\") pod \"9480e89b-4c84-4295-96c9-35a9913299d3\" (UID: \"9480e89b-4c84-4295-96c9-35a9913299d3\") "
Sep 15 20:36:34.028388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028220    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache" (OuterVolumeSpecName: "model-cache") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:34.028388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028233    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:34.028388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028364    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home" (OuterVolumeSpecName: "home") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:34.028555 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028374    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:34.028555 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.028421    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:34.030245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.030211    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm" (OuterVolumeSpecName: "dshm") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:36:34.030388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.030321    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4" (OuterVolumeSpecName: "kube-api-access-klhl4") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "kube-api-access-klhl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:36:34.030388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.030331    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "9480e89b-4c84-4295-96c9-35a9913299d3" (UID: "9480e89b-4c84-4295-96c9-35a9913299d3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:36:34.097469 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.097437    2554 generic.go:356] "Generic (PLEG): container finished" podID="9480e89b-4c84-4295-96c9-35a9913299d3" containerID="99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5" exitCode=0
Sep 15 20:36:34.097687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.097491    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"
Sep 15 20:36:34.097687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.097525    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" event={"ID":"9480e89b-4c84-4295-96c9-35a9913299d3","Type":"ContainerDied","Data":"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"}
Sep 15 20:36:34.097687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.097582    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m" event={"ID":"9480e89b-4c84-4295-96c9-35a9913299d3","Type":"ContainerDied","Data":"5ca3a947814d91b2fe84f332e146c6b8f1eadda70a50962225069979deb952f9"}
Sep 15 20:36:34.097687 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.097599    2554 scope.go:117] "RemoveContainer" containerID="99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"
Sep 15 20:36:34.106941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.106919    2554 scope.go:117] "RemoveContainer" containerID="99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"
Sep 15 20:36:34.107284 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:36:34.107260    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5\": container with ID starting with 99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5 not found: ID does not exist" containerID="99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"
Sep 15 20:36:34.107409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.107292    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5"} err="failed to get container status \"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5\": rpc error: code = NotFound desc = could not find container \"99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5\": container with ID starting with 99753140cb5b79569ee7ac9bc76c08f3bc150af23d36292f2ad9986caebe99d5 not found: ID does not exist"
Sep 15 20:36:34.118313 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.118284    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:36:34.120349 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.120326    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-725e67/simulator-w4-725e67-kserve-f97f5bcf7-rvj9m"]
Sep 15 20:36:34.128922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.128894    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9480e89b-4c84-4295-96c9-35a9913299d3-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:34.129071 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.129026    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:34.129168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.129152    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klhl4\" (UniqueName: \"kubernetes.io/projected/9480e89b-4c84-4295-96c9-35a9913299d3-kube-api-access-klhl4\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:34.129224 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:34.129174    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9480e89b-4c84-4295-96c9-35a9913299d3-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:36:36.023922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:36.023804    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9480e89b-4c84-4295-96c9-35a9913299d3" path="/var/lib/kubelet/pods/9480e89b-4c84-4295-96c9-35a9913299d3/volumes"
Sep 15 20:36:43.130699 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:43.130661    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:36:58.737899 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:36:58.737859    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:37:06.384537 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:06.384506    2554 scope.go:117] "RemoveContainer" containerID="011d919f5c5bb64df679201833625d3d3c6df1b6cd7f2bd512209e5914933d54"
Sep 15 20:37:16.339446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:16.339408    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:37:32.331714 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:32.331678    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:37:34.615314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:34.615276    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:37:44.123716 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:44.123678    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:37:49.634721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.634660    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" podUID="27740de3-4151-4cf7-8588-11dec1edaee6" containerName="main" containerID="cri-o://ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3" gracePeriod=45
Sep 15 20:37:49.881243 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.881217    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:37:49.990233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990192    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990266    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p524v\" (UniqueName: \"kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990293    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990319    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990436 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990395    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990443    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir\") pod \"27740de3-4151-4cf7-8588-11dec1edaee6\" (UID: \"27740de3-4151-4cf7-8588-11dec1edaee6\") "
Sep 15 20:37:49.990643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990509    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home" (OuterVolumeSpecName: "home") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:37:49.990755 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990710    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache" (OuterVolumeSpecName: "model-cache") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:37:49.990807 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990753    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:37:49.990858 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.990810    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:49.992615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.992582    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm" (OuterVolumeSpecName: "dshm") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:37:49.992615 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.992607    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v" (OuterVolumeSpecName: "kube-api-access-p524v") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "kube-api-access-p524v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:37:49.992784 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:49.992646    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "27740de3-4151-4cf7-8588-11dec1edaee6" (UID: "27740de3-4151-4cf7-8588-11dec1edaee6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:37:50.091539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.091495    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p524v\" (UniqueName: \"kubernetes.io/projected/27740de3-4151-4cf7-8588-11dec1edaee6-kube-api-access-p524v\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:50.091539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.091531    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27740de3-4151-4cf7-8588-11dec1edaee6-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:50.091539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.091542    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:50.091539 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.091551    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:50.091815 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.091559    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/27740de3-4151-4cf7-8588-11dec1edaee6-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:37:50.462308 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.462267    2554 generic.go:356] "Generic (PLEG): container finished" podID="27740de3-4151-4cf7-8588-11dec1edaee6" containerID="ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3" exitCode=0
Sep 15 20:37:50.462480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.462314    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"
Sep 15 20:37:50.462480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.462325    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" event={"ID":"27740de3-4151-4cf7-8588-11dec1edaee6","Type":"ContainerDied","Data":"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"}
Sep 15 20:37:50.462480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.462373    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm" event={"ID":"27740de3-4151-4cf7-8588-11dec1edaee6","Type":"ContainerDied","Data":"1ecebd082b649666979ba473304c98beb4140cedd3205f0868eecd41ca1c2c3d"}
Sep 15 20:37:50.462480 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.462395    2554 scope.go:117] "RemoveContainer" containerID="ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"
Sep 15 20:37:50.470595 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.470578    2554 scope.go:117] "RemoveContainer" containerID="ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"
Sep 15 20:37:50.470875 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:37:50.470858    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3\": container with ID starting with ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3 not found: ID does not exist" containerID="ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"
Sep 15 20:37:50.470925 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.470894    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3"} err="failed to get container status \"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3\": rpc error: code = NotFound desc = could not find container \"ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3\": container with ID starting with ac6331f6ada197286b8a6a5f0afd1b3eff9789e267a5f081d819379331c8ede3 not found: ID does not exist"
Sep 15 20:37:50.480528 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.480494    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:37:50.484123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:50.484100    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-92702a/sub-test-model-92702a-kserve-5fb5fb9f57-9t2cm"]
Sep 15 20:37:52.023025 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:52.022972    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27740de3-4151-4cf7-8588-11dec1edaee6" path="/var/lib/kubelet/pods/27740de3-4151-4cf7-8588-11dec1edaee6/volumes"
Sep 15 20:37:59.129206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:37:59.129120    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:38:30.328604 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.328564    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329018    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27740de3-4151-4cf7-8588-11dec1edaee6" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329036    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="27740de3-4151-4cf7-8588-11dec1edaee6" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329048    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f1a7d76-3140-4b8b-b79a-cd32f12927d6" containerName="revoke-keys"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329056    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f1a7d76-3140-4b8b-b79a-cd32f12927d6" containerName="revoke-keys"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329079    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e57749f7-23cc-4124-8ca6-d02a447487d8" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329085    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="e57749f7-23cc-4124-8ca6-d02a447487d8" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329096    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9480e89b-4c84-4295-96c9-35a9913299d3" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329101    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="9480e89b-4c84-4295-96c9-35a9913299d3" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329152    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="27740de3-4151-4cf7-8588-11dec1edaee6" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329161    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="9480e89b-4c84-4295-96c9-35a9913299d3" containerName="main"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329166    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f1a7d76-3140-4b8b-b79a-cd32f12927d6" containerName="revoke-keys"
Sep 15 20:38:30.331127 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.329177    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="e57749f7-23cc-4124-8ca6-d02a447487d8" containerName="main"
Sep 15 20:38:30.332017 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.331997    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.335665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.335631    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"rate-test-model-e80b38-kserve-self-signed-certs\""
Sep 15 20:38:30.335787 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.335664    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"kube-root-ca.crt\""
Sep 15 20:38:30.335787 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.335725    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"default-dockercfg-lgr7w\""
Sep 15 20:38:30.335787 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.335767    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e80b38\"/\"openshift-service-ca.crt\""
Sep 15 20:38:30.341733 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.341705    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:38:30.450773 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450734    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.450973 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450793    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.450973 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450826    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.450973 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450862    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.450973 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450890    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m2rp\" (UniqueName: \"kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.450973 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.450923    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551617    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551673    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m2rp\" (UniqueName: \"kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551709    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551753    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551812    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.551846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.551839    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.552196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.552161    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.552258 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.552225    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.552304 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.552264    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.554012 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.553971    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.554270 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.554254    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.560031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.559958    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m2rp\" (UniqueName: \"kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp\") pod \"rate-test-model-e80b38-kserve-748978994c-vvbfj\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") " pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.641854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.641758    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:30.912171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:30.912138    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:38:30.913741 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:38:30.913704    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3979af47_a62c_47c0_a96b_d55826542a13.slice/crio-d1cc1b8860b7bac9ae7600ab62cf71df5e481c08417efa5a1f220a5bfb221583 WatchSource:0}: Error finding container d1cc1b8860b7bac9ae7600ab62cf71df5e481c08417efa5a1f220a5bfb221583: Status 404 returned error can't find the container with id d1cc1b8860b7bac9ae7600ab62cf71df5e481c08417efa5a1f220a5bfb221583
Sep 15 20:38:31.649107 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:31.649070    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" event={"ID":"3979af47-a62c-47c0-a96b-d55826542a13","Type":"ContainerStarted","Data":"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"}
Sep 15 20:38:31.649519 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:31.649123    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" event={"ID":"3979af47-a62c-47c0-a96b-d55826542a13","Type":"ContainerStarted","Data":"d1cc1b8860b7bac9ae7600ab62cf71df5e481c08417efa5a1f220a5bfb221583"}
Sep 15 20:38:31.665214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:31.665159    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" podStartSLOduration=1.6651115490000001 podStartE2EDuration="1.665111549s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:38:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:38:31.664157594 +0000 UTC m=+2006.109116606" watchObservedRunningTime="2026-09-15 20:38:31.665111549 +0000 UTC m=+2006.110070558"
Sep 15 20:38:34.235101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:34.235063    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:38:40.642104 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:40.642071    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:40.642492 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:40.642221    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:40.654747 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:40.654715    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:40.703409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:40.703376    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:38:54.328199 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:38:54.328155    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:39:04.425560 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:04.425519    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:39:11.535369 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:11.535335    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:39:12.282805 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.282768    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:39:12.286101 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.286079    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.288643 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.288613    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c005f8-openshift-default-dockercfg-trhsq\""
Sep 15 20:39:12.301113 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.301090    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:39:12.311445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311419    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311459    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311493    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311519    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311538    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311564    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twfvz\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311594    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311623    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.311829 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.311657    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412334 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412297    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412334 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412339    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412359    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412386    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twfvz\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412415    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412458    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412487    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412582    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412905 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412632    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.412905 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412821    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.413002 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412917    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.413002 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.412933    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.413066 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.413053    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.413214 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.413194    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.414778 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.414759    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.414922 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.414906    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.419938 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.419911    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.420098 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.420080    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twfvz\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz\") pod \"e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") " pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.596843 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.596750    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:12.873499 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.873464    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:39:12.875374 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:39:12.875343    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f011a59_6bad_4d70_9d88_e90f4e0088fc.slice/crio-53393472e8267244c4e3430e695a5a580424694071b28e5a47439917b5969527 WatchSource:0}: Error finding container 53393472e8267244c4e3430e695a5a580424694071b28e5a47439917b5969527: Status 404 returned error can't find the container with id 53393472e8267244c4e3430e695a5a580424694071b28e5a47439917b5969527
Sep 15 20:39:12.877753 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.877715    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:12.877859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.877793    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:12.877859 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:12.877826    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:13.843775 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:13.843738    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerStarted","Data":"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"}
Sep 15 20:39:13.844233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:13.843792    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerStarted","Data":"53393472e8267244c4e3430e695a5a580424694071b28e5a47439917b5969527"}
Sep 15 20:39:13.863333 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:13.863285    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podStartSLOduration=1.8632691860000001 podStartE2EDuration="1.863269186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:39:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:39:13.861861857 +0000 UTC m=+2048.306820865" watchObservedRunningTime="2026-09-15 20:39:13.863269186 +0000 UTC m=+2048.308228247"
Sep 15 20:39:14.597709 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:14.597671    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:14.602651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:14.602623    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:14.850047 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:14.849962    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:14.850943 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:14.850924    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:17.627123 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.627083    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:39:17.630267 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.630249    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.633594 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.633567    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-c005f8-dockercfg-nnsj9\""
Sep 15 20:39:17.633730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.633567    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-c005f8\""
Sep 15 20:39:17.649857 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.649813    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sf7d\" (UniqueName: \"kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.650085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.649871    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.652151 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.652126    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:39:17.750484 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.750443    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sf7d\" (UniqueName: \"kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.750694 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.750492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.751305 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.751285    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.766681 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.766648    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sf7d\" (UniqueName: \"kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d\") pod \"payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:17.941641 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:17.941544    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:18.212253 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:18.212225    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:39:18.214739 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:39:18.214712    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05775494_6329_4c4b_948e_aa15bd307665.slice/crio-2d169ee00d4b321ccbd3df4aa63955dadb357b39275f4a492f92aecc5d090c98 WatchSource:0}: Error finding container 2d169ee00d4b321ccbd3df4aa63955dadb357b39275f4a492f92aecc5d090c98: Status 404 returned error can't find the container with id 2d169ee00d4b321ccbd3df4aa63955dadb357b39275f4a492f92aecc5d090c98
Sep 15 20:39:18.871032 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:18.870972    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" event={"ID":"05775494-6329-4c4b-948e-aa15bd307665","Type":"ContainerStarted","Data":"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"}
Sep 15 20:39:18.871427 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:18.871050    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" event={"ID":"05775494-6329-4c4b-948e-aa15bd307665","Type":"ContainerStarted","Data":"2d169ee00d4b321ccbd3df4aa63955dadb357b39275f4a492f92aecc5d090c98"}
Sep 15 20:39:18.871427 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:18.871164    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:18.887676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:18.887625    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" podStartSLOduration=1.887610251 podStartE2EDuration="1.887610251s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:39:18.885846346 +0000 UTC m=+2053.330805356" watchObservedRunningTime="2026-09-15 20:39:18.887610251 +0000 UTC m=+2053.332569320"
Sep 15 20:39:20.928400 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:20.928364    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:39:26.557438 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.557385    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" podUID="3979af47-a62c-47c0-a96b-d55826542a13" containerName="main" containerID="cri-o://d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b" gracePeriod=45
Sep 15 20:39:26.817481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.817415    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:39:26.910999 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.910946    2554 generic.go:356] "Generic (PLEG): container finished" podID="3979af47-a62c-47c0-a96b-d55826542a13" containerID="d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b" exitCode=0
Sep 15 20:39:26.910999 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.911001    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"
Sep 15 20:39:26.911211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.911035    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" event={"ID":"3979af47-a62c-47c0-a96b-d55826542a13","Type":"ContainerDied","Data":"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"}
Sep 15 20:39:26.911211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.911085    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj" event={"ID":"3979af47-a62c-47c0-a96b-d55826542a13","Type":"ContainerDied","Data":"d1cc1b8860b7bac9ae7600ab62cf71df5e481c08417efa5a1f220a5bfb221583"}
Sep 15 20:39:26.911211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.911105    2554 scope.go:117] "RemoveContainer" containerID="d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"
Sep 15 20:39:26.919563 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.919545    2554 scope.go:117] "RemoveContainer" containerID="d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"
Sep 15 20:39:26.919845 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:39:26.919829    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b\": container with ID starting with d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b not found: ID does not exist" containerID="d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"
Sep 15 20:39:26.919895 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.919854    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b"} err="failed to get container status \"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b\": rpc error: code = NotFound desc = could not find container \"d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b\": container with ID starting with d5b0ab04c5740616a07b1fe21ef86c4dba9010b5053e5c8ed4ca77bbc6ac8c9b not found: ID does not exist"
Sep 15 20:39:26.927195 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927174    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927300 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927202    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927300 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927256    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927300 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927291    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5m2rp\" (UniqueName: \"kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927311    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927446 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927371    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache\") pod \"3979af47-a62c-47c0-a96b-d55826542a13\" (UID: \"3979af47-a62c-47c0-a96b-d55826542a13\") "
Sep 15 20:39:26.927554 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927517    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:39:26.927646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927614    2554 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-tmp-dir\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:26.927646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927622    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home" (OuterVolumeSpecName: "home") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:39:26.927828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.927698    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache" (OuterVolumeSpecName: "model-cache") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:39:26.929421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.929390    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm" (OuterVolumeSpecName: "dshm") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:39:26.929421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.929407    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:39:26.929590 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:26.929424    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp" (OuterVolumeSpecName: "kube-api-access-5m2rp") pod "3979af47-a62c-47c0-a96b-d55826542a13" (UID: "3979af47-a62c-47c0-a96b-d55826542a13"). InnerVolumeSpecName "kube-api-access-5m2rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:39:27.028155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.028108    2554 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3979af47-a62c-47c0-a96b-d55826542a13-tls-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:27.028155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.028149    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5m2rp\" (UniqueName: \"kubernetes.io/projected/3979af47-a62c-47c0-a96b-d55826542a13-kube-api-access-5m2rp\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:27.028155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.028160    2554 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-home\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:27.028155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.028168    2554 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-model-cache\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:27.028155 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.028177    2554 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3979af47-a62c-47c0-a96b-d55826542a13-dshm\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:39:27.231476 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.231427    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:39:27.236168 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:27.236131    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e80b38/rate-test-model-e80b38-kserve-748978994c-vvbfj"]
Sep 15 20:39:28.024754 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:28.024719    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3979af47-a62c-47c0-a96b-d55826542a13" path="/var/lib/kubelet/pods/3979af47-a62c-47c0-a96b-d55826542a13/volumes"
Sep 15 20:39:29.878717 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:29.878681    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:39:30.865035 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.864970    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 20:39:30.865228 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.865053    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 20:39:30.935038 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.935006    2554 generic.go:356] "Generic (PLEG): container finished" podID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerID="246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a" exitCode=0
Sep 15 20:39:30.935402 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.935072    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerDied","Data":"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"}
Sep 15 20:39:30.935474 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.935459    2554 scope.go:117] "RemoveContainer" containerID="246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"
Sep 15 20:39:30.936617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.936579    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:30.936683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.936664    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:30.936721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:30.936707    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:31.946610 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:31.946553    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerStarted","Data":"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"}
Sep 15 20:39:32.597555 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:32.597506    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:32.597809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:32.597783    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 20:39:32.597896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:32.597844    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 20:39:33.598117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:33.598077    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 20:39:33.598522 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:33.598148    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 20:39:34.597698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:34.597654    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 20:39:34.597919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:34.597710    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 20:39:35.597190 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:35.597151    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 20:39:35.597676 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:35.597208    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 20:39:36.597456 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:36.597417    2554 patch_prober.go:28] interesting pod/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused" start-of-body=
Sep 15 20:39:36.597863 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:36.597473    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.80:15021/healthz/ready\": dial tcp 10.134.0.80:15021: connect: connection refused"
Sep 15 20:39:37.601409 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:37.601370    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:37.601826 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:37.601615    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:37.602397 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:37.602379    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:39:41.736816 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.736775    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:39:41.737314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.737109    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3979af47-a62c-47c0-a96b-d55826542a13" containerName="main"
Sep 15 20:39:41.737314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.737120    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="3979af47-a62c-47c0-a96b-d55826542a13" containerName="main"
Sep 15 20:39:41.737314 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.737184    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="3979af47-a62c-47c0-a96b-d55826542a13" containerName="main"
Sep 15 20:39:41.740072 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.740050    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.742751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.742718    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-8dc819-openshift-default-dockercfg-f5x95\""
Sep 15 20:39:41.760175 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.760146    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:39:41.869557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869507    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869557 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869564    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869642    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869698    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjmq4\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869745    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869764    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869822    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869840    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.869946 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.869878    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970591    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjmq4\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970626 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970631    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970648    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970689    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970949 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970859    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.970949 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970910    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.970957    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971036    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971080    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971128 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971107    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971233    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971345 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971286    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971484 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971461    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.971751 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.971727    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.972994 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.972962    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.973490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.973468    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.979171 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.979150    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:41.979562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:41.979546    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjmq4\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4\") pod \"e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") " pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:42.051228 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:42.051132    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:42.326131 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:42.325993    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:39:42.328390 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:39:42.328360    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6971fd7b_d459_4346_b546_a65e11b4264c.slice/crio-9f0af2920df4e39fd71d13179a1a8b648b4323737da048f50eae02af9472155e WatchSource:0}: Error finding container 9f0af2920df4e39fd71d13179a1a8b648b4323737da048f50eae02af9472155e: Status 404 returned error can't find the container with id 9f0af2920df4e39fd71d13179a1a8b648b4323737da048f50eae02af9472155e
Sep 15 20:39:42.330644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:42.330607    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:42.330723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:42.330678    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:42.330723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:42.330708    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:39:43.003354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:43.003320    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerStarted","Data":"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"}
Sep 15 20:39:43.003354 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:43.003373    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerStarted","Data":"9f0af2920df4e39fd71d13179a1a8b648b4323737da048f50eae02af9472155e"}
Sep 15 20:39:43.026906 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:43.026848    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podStartSLOduration=2.026829084 podStartE2EDuration="2.026829084s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:39:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:39:43.024538108 +0000 UTC m=+2077.469497129" watchObservedRunningTime="2026-09-15 20:39:43.026829084 +0000 UTC m=+2077.471788091"
Sep 15 20:39:43.052246 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:43.052202    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:43.057303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:43.057277    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:44.008778 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:44.008747    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:44.009699 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:44.009678    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:39:52.438890 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:39:52.438851    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:40:03.099691 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.099655    2554 generic.go:356] "Generic (PLEG): container finished" podID="6971fd7b-d459-4346-b546-a65e11b4264c" containerID="09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1" exitCode=0
Sep 15 20:40:03.100211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.099725    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerDied","Data":"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"}
Sep 15 20:40:03.100211 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.100147    2554 scope.go:117] "RemoveContainer" containerID="09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"
Sep 15 20:40:03.101242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.101208    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:03.101339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.101287    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:03.101339 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:03.101320    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:04.106118 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:04.106082    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerStarted","Data":"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"}
Sep 15 20:40:05.052139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:05.052092    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:40:05.052405 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:05.052247    2554 patch_prober.go:28] interesting pod/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 15 20:40:05.052405 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:05.052297    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 15 20:40:06.052085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:06.052045    2554 patch_prober.go:28] interesting pod/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 15 20:40:06.052792 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:06.052758    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 15 20:40:06.427773 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:06.427678    2554 scope.go:117] "RemoveContainer" containerID="d3f84cd0b32750ff3f0abc455bcee14ebe4f2de629a1425290fb09ebf4f85af8"
Sep 15 20:40:07.051951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:07.051897    2554 patch_prober.go:28] interesting pod/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 15 20:40:07.052195 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:07.051975    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 15 20:40:08.051856 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:08.051802    2554 patch_prober.go:28] interesting pod/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 15 20:40:08.052111 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:08.051893    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 15 20:40:09.052438 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:09.052394    2554 patch_prober.go:28] interesting pod/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused" start-of-body=
Sep 15 20:40:09.053091 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:09.053050    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.82:15021/healthz/ready\": dial tcp 10.134.0.82:15021: connect: connection refused"
Sep 15 20:40:10.056080 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:10.056047    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:40:10.056579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:10.056560    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:40:10.057236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:10.057218    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:40:28.240003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:28.239951    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:40:45.130553 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:45.130512    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:40:50.854683 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:50.854646    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm_05775494-6329-4c4b-948e-aa15bd307665/payload-processing/0.log"
Sep 15 20:40:51.630307 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.630274    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:40:51.633882 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.633856    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.636491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.636464    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-a6b11e-openshift-default-dockercfg-xl8pl\""
Sep 15 20:40:51.646387 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.646359    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:40:51.710328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710289    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710337    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710361    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x8k2\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710442    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710544 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710506    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710562    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710603    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710717    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.710868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.710763    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811450 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811389    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811492    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811521    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811554    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811585    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811618    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x8k2\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811648    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811698    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811756    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811847    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.811939 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811919    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.812275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.811954    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.812275 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.812095    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.812396 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.812376    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.814052 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.814029    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.814271 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.814252    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.820417 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.820392    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.820662 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.820639    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x8k2\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2\") pod \"e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") " pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:51.945613 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:51.945514    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:52.222069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.222013    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:40:52.224333 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:40:52.224305    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9c99f9_77b5_44dd_b7b8_2d3fe5bb57e8.slice/crio-cf0eb6505a967b19d509c576e834b9b816ceec0cd2f55274d9ef0a4d8ee7db55 WatchSource:0}: Error finding container cf0eb6505a967b19d509c576e834b9b816ceec0cd2f55274d9ef0a4d8ee7db55: Status 404 returned error can't find the container with id cf0eb6505a967b19d509c576e834b9b816ceec0cd2f55274d9ef0a4d8ee7db55
Sep 15 20:40:52.226623 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.226586    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:52.226723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.226656    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:52.226723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.226685    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:40:52.340327 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.340288    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerStarted","Data":"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"}
Sep 15 20:40:52.340527 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.340356    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerStarted","Data":"cf0eb6505a967b19d509c576e834b9b816ceec0cd2f55274d9ef0a4d8ee7db55"}
Sep 15 20:40:52.359530 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.359473    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podStartSLOduration=1.359453531 podStartE2EDuration="1.359453531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:40:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:40:52.357848739 +0000 UTC m=+2146.802807751" watchObservedRunningTime="2026-09-15 20:40:52.359453531 +0000 UTC m=+2146.804412540"
Sep 15 20:40:52.946065 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:52.946034    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:53.952353 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:53.952314    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:54.349435 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:54.349405    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:54.350515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:54.350491    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:40:57.966242 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:57.966208    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:40:57.969854 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:57.969832    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:57.972236 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:57.972211    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-a6b11e-dockercfg-4jrr2\""
Sep 15 20:40:57.972400 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:57.972375    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-a6b11e\""
Sep 15 20:40:57.978767 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:57.978740    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:40:58.069248 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.069204    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtdfd\" (UniqueName: \"kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.069442 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.069298    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.170571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.170483    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtdfd\" (UniqueName: \"kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.170571 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.170550    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.171294 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.171273    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.178968 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.178945    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtdfd\" (UniqueName: \"kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd\") pod \"payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.281597 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.281503    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:58.554599 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:58.554538    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:40:59.377367 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:59.377328    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" event={"ID":"1b677a11-7eb3-48ce-9dc9-f828f89636e7","Type":"ContainerStarted","Data":"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"}
Sep 15 20:40:59.377786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:59.377388    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" event={"ID":"1b677a11-7eb3-48ce-9dc9-f828f89636e7","Type":"ContainerStarted","Data":"9a299ad68b03036431ebed5be2c30bdb6e7bfecd5465c47c1ceee6eacff486dc"}
Sep 15 20:40:59.377786 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:59.377444    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:40:59.395589 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:40:59.395524    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" podStartSLOduration=2.395500375 podStartE2EDuration="2.395500375s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:40:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:40:59.393123578 +0000 UTC m=+2153.838082587" watchObservedRunningTime="2026-09-15 20:40:59.395500375 +0000 UTC m=+2153.840459386"
Sep 15 20:41:04.131867 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:04.131828    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:41:06.458491 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:06.458447    2554 scope.go:117] "RemoveContainer" containerID="5a365b23e852e6d9c7a15efd184311b210a91f98ee97ae0de62241f564be7360"
Sep 15 20:41:06.466849 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:06.466821    2554 scope.go:117] "RemoveContainer" containerID="9df59c12b2c6ef7690f39bcade28256071a602a0d22dd745a298b87ff72dd74b"
Sep 15 20:41:10.384465 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:10.384429    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:41:14.453975 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.453939    2554 generic.go:356] "Generic (PLEG): container finished" podID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerID="05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb" exitCode=0
Sep 15 20:41:14.454488 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.454013    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerDied","Data":"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"}
Sep 15 20:41:14.454488 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.454429    2554 scope.go:117] "RemoveContainer" containerID="05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"
Sep 15 20:41:14.455625 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.455594    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:41:14.455700 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.455682    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:41:14.455741 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:14.455726    2554 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236200Ki","pods":"250"}
Sep 15 20:41:15.462586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:15.462553    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerStarted","Data":"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"}
Sep 15 20:41:15.947004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:15.946882    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:15.947194 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:15.947044    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 15 20:41:15.947194 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:15.947093    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 15 20:41:16.946902 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:16.946854    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 15 20:41:16.947413 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:16.946927    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 15 20:41:17.946156 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:17.946108    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 15 20:41:17.946509 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:17.946467    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 15 20:41:18.946663 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:18.946613    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 15 20:41:18.947202 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:18.946708    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 15 20:41:19.946095 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:19.946055    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused" start-of-body=
Sep 15 20:41:19.946315 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:19.946142    2554 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.83:15021/healthz/ready\": dial tcp 10.134.0.83:15021: connect: connection refused"
Sep 15 20:41:20.950651 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:20.950620    2554 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:20.951143 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:20.950964    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:20.951846 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:20.951827    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:26.218233 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.218193    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:41:26.218721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.218449    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" podUID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" containerName="payload-processing" containerID="cri-o://1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af" gracePeriod=30
Sep 15 20:41:26.501414 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.501383    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:41:26.518309 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.518263    2554 generic.go:356] "Generic (PLEG): container finished" podID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" containerID="1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af" exitCode=0
Sep 15 20:41:26.518960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.518333    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"
Sep 15 20:41:26.518960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.518335    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" event={"ID":"1b677a11-7eb3-48ce-9dc9-f828f89636e7","Type":"ContainerDied","Data":"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"}
Sep 15 20:41:26.518960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.518482    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5" event={"ID":"1b677a11-7eb3-48ce-9dc9-f828f89636e7","Type":"ContainerDied","Data":"9a299ad68b03036431ebed5be2c30bdb6e7bfecd5465c47c1ceee6eacff486dc"}
Sep 15 20:41:26.518960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.518506    2554 scope.go:117] "RemoveContainer" containerID="1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"
Sep 15 20:41:26.529444 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.529417    2554 scope.go:117] "RemoveContainer" containerID="1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"
Sep 15 20:41:26.529764 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:41:26.529739    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af\": container with ID starting with 1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af not found: ID does not exist" containerID="1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"
Sep 15 20:41:26.529953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.529777    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af"} err="failed to get container status \"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af\": rpc error: code = NotFound desc = could not find container \"1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af\": container with ID starting with 1c14c0dae2896a6d50f9fabfb3c4368996f109dcff78aac8a8e7c01c814457af not found: ID does not exist"
Sep 15 20:41:26.651278 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.651235    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume\") pod \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") "
Sep 15 20:41:26.651499 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.651415    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtdfd\" (UniqueName: \"kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd\") pod \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\" (UID: \"1b677a11-7eb3-48ce-9dc9-f828f89636e7\") "
Sep 15 20:41:26.651712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.651682    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b677a11-7eb3-48ce-9dc9-f828f89636e7" (UID: "1b677a11-7eb3-48ce-9dc9-f828f89636e7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:41:26.653534 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.653503    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd" (OuterVolumeSpecName: "kube-api-access-jtdfd") pod "1b677a11-7eb3-48ce-9dc9-f828f89636e7" (UID: "1b677a11-7eb3-48ce-9dc9-f828f89636e7"). InnerVolumeSpecName "kube-api-access-jtdfd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:41:26.752448 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.752334    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtdfd\" (UniqueName: \"kubernetes.io/projected/1b677a11-7eb3-48ce-9dc9-f828f89636e7-kube-api-access-jtdfd\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:26.752448 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.752384    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b677a11-7eb3-48ce-9dc9-f828f89636e7-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:26.841585 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.841498    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:41:26.843514 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:26.843489    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-a6b11e-999857ccf-r22g5"]
Sep 15 20:41:28.023296 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:28.023261    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" path="/var/lib/kubelet/pods/1b677a11-7eb3-48ce-9dc9-f828f89636e7/volumes"
Sep 15 20:41:31.027772 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:31.027732    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:41:32.784357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:32.784319    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:41:32.784810 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:32.784596    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" containerID="cri-o://216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9" gracePeriod=30
Sep 15 20:41:35.953361 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:35.953315    2554 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 20:41:35.953775 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:35.953384    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 20:41:38.052808 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.052729    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:38.152443 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152406    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152443 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152454    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152480    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x8k2\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152507    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152537    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152567    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152585    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152631    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.152712 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152662    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy\") pod \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\" (UID: \"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8\") "
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152749    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152795    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152946    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.152959    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.153083    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.153099    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.153119 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.153122    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.153461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.153131    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.153461 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.153140    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.154880 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.154841    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:41:38.155040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.154944    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:41:38.155040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.154957    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:41:38.155040 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.154970    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2" (OuterVolumeSpecName: "kube-api-access-5x8k2") pod "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" (UID: "0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8"). InnerVolumeSpecName "kube-api-access-5x8k2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:41:38.254082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.254044    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.254082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.254076    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.254082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.254089    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.254326 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.254098    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x8k2\" (UniqueName: \"kubernetes.io/projected/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-kube-api-access-5x8k2\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.254326 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.254107    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:38.579481 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.579436    2554 generic.go:356] "Generic (PLEG): container finished" podID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerID="216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9" exitCode=0
Sep 15 20:41:38.579665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.579492    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"
Sep 15 20:41:38.579665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.579497    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerDied","Data":"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"}
Sep 15 20:41:38.579665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.579553    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s" event={"ID":"0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8","Type":"ContainerDied","Data":"cf0eb6505a967b19d509c576e834b9b816ceec0cd2f55274d9ef0a4d8ee7db55"}
Sep 15 20:41:38.579665 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.579583    2554 scope.go:117] "RemoveContainer" containerID="216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"
Sep 15 20:41:38.591394 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.591373    2554 scope.go:117] "RemoveContainer" containerID="05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"
Sep 15 20:41:38.601085 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.601054    2554 scope.go:117] "RemoveContainer" containerID="216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"
Sep 15 20:41:38.601424 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:41:38.601406    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9\": container with ID starting with 216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9 not found: ID does not exist" containerID="216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"
Sep 15 20:41:38.601478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.601433    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9"} err="failed to get container status \"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9\": rpc error: code = NotFound desc = could not find container \"216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9\": container with ID starting with 216d2dd2cb25ca26a2e915614e62bdb6fceafe28019e12e9a5611f324784bef9 not found: ID does not exist"
Sep 15 20:41:38.601478 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.601452    2554 scope.go:117] "RemoveContainer" containerID="05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"
Sep 15 20:41:38.601740 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:41:38.601724    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb\": container with ID starting with 05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb not found: ID does not exist" containerID="05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"
Sep 15 20:41:38.601788 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.601743    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb"} err="failed to get container status \"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb\": rpc error: code = NotFound desc = could not find container \"05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb\": container with ID starting with 05fe09cdd1863bd92f194c755d9914ee0b739eb1091982893f021d0e74be5bdb not found: ID does not exist"
Sep 15 20:41:38.601917 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.601898    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:41:38.605069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:38.605039    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-a6b11e-openshift-default-669795dbd-2vb2s"]
Sep 15 20:41:40.023490 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:40.023445    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" path="/var/lib/kubelet/pods/0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8/volumes"
Sep 15 20:41:50.041042 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:50.041011    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:41:51.989109 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:51.989075    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:41:51.989552 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:51.989296    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" podUID="05775494-6329-4c4b-948e-aa15bd307665" containerName="payload-processing" containerID="cri-o://6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde" gracePeriod=30
Sep 15 20:41:52.014545 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:41:52.014363    2554 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05775494_6329_4c4b_948e_aa15bd307665.slice/crio-6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 20:41:52.250785 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.250699    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:41:52.377621 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.377581    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume\") pod \"05775494-6329-4c4b-948e-aa15bd307665\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") "
Sep 15 20:41:52.377817 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.377797    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sf7d\" (UniqueName: \"kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d\") pod \"05775494-6329-4c4b-948e-aa15bd307665\" (UID: \"05775494-6329-4c4b-948e-aa15bd307665\") "
Sep 15 20:41:52.378087 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.378061    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05775494-6329-4c4b-948e-aa15bd307665" (UID: "05775494-6329-4c4b-948e-aa15bd307665"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:41:52.379940 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.379909    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d" (OuterVolumeSpecName: "kube-api-access-5sf7d") pod "05775494-6329-4c4b-948e-aa15bd307665" (UID: "05775494-6329-4c4b-948e-aa15bd307665"). InnerVolumeSpecName "kube-api-access-5sf7d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:41:52.479251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.479213    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sf7d\" (UniqueName: \"kubernetes.io/projected/05775494-6329-4c4b-948e-aa15bd307665-kube-api-access-5sf7d\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:52.479251 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.479243    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05775494-6329-4c4b-948e-aa15bd307665-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:41:52.647498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.647401    2554 generic.go:356] "Generic (PLEG): container finished" podID="05775494-6329-4c4b-948e-aa15bd307665" containerID="6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde" exitCode=0
Sep 15 20:41:52.647498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.647459    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" event={"ID":"05775494-6329-4c4b-948e-aa15bd307665","Type":"ContainerDied","Data":"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"}
Sep 15 20:41:52.647498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.647460    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"
Sep 15 20:41:52.647498 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.647500    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm" event={"ID":"05775494-6329-4c4b-948e-aa15bd307665","Type":"ContainerDied","Data":"2d169ee00d4b321ccbd3df4aa63955dadb357b39275f4a492f92aecc5d090c98"}
Sep 15 20:41:52.647825 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.647522    2554 scope.go:117] "RemoveContainer" containerID="6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"
Sep 15 20:41:52.656437 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.656412    2554 scope.go:117] "RemoveContainer" containerID="6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"
Sep 15 20:41:52.656740 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:41:52.656716    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde\": container with ID starting with 6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde not found: ID does not exist" containerID="6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"
Sep 15 20:41:52.656809 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.656750    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde"} err="failed to get container status \"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde\": rpc error: code = NotFound desc = could not find container \"6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde\": container with ID starting with 6134d9c4a10474d65e0636374863c2aaa80b9a18c7680471c4e9b0363d649fde not found: ID does not exist"
Sep 15 20:41:52.669564 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.669520    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:41:52.673169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:52.673144    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-c005f8-59dffc985-2jlcm"]
Sep 15 20:41:54.024172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:41:54.024135    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05775494-6329-4c4b-948e-aa15bd307665" path="/var/lib/kubelet/pods/05775494-6329-4c4b-948e-aa15bd307665/volumes"
Sep 15 20:42:02.136646 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:02.136609    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:42:46.128605 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:46.128567    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:42:46.129185 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:46.128854    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy" containerID="cri-o://f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125" gracePeriod=30
Sep 15 20:42:51.387386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.387311    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:42:51.500832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.500789    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.500832 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.500836    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.500880    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.500912    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.500946    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501018    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501056    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twfvz\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501139 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501091    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501149    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket\") pod \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\" (UID: \"8f011a59-6bad-4d70-9d88-e90f4e0088fc\") "
Sep 15 20:42:51.501463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501153    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:42:51.501463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501280    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:42:51.501463 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501375    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:42:51.501657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501523    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:42:51.501657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501550    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.501657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501571    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.501657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501585    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.501657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.501587    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data" (OuterVolumeSpecName: "istio-data") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:42:51.503248 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.503221    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token" (OuterVolumeSpecName: "istio-token") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:42:51.503389 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.503323    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:42:51.503623 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.503601    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz" (OuterVolumeSpecName: "kube-api-access-twfvz") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "kube-api-access-twfvz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:42:51.503623 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.503610    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8f011a59-6bad-4d70-9d88-e90f4e0088fc" (UID: "8f011a59-6bad-4d70-9d88-e90f4e0088fc"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:42:51.602434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602375    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.602434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602425    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twfvz\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-kube-api-access-twfvz\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.602434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602439    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.602434 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602452    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f011a59-6bad-4d70-9d88-e90f4e0088fc-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.602732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602463    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.602732 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.602477    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f011a59-6bad-4d70-9d88-e90f4e0088fc-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:42:51.922582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.922537    2554 generic.go:356] "Generic (PLEG): container finished" podID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerID="f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125" exitCode=0
Sep 15 20:42:51.922759 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.922586    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"
Sep 15 20:42:51.922759 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.922623    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerDied","Data":"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"}
Sep 15 20:42:51.922759 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.922679    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc" event={"ID":"8f011a59-6bad-4d70-9d88-e90f4e0088fc","Type":"ContainerDied","Data":"53393472e8267244c4e3430e695a5a580424694071b28e5a47439917b5969527"}
Sep 15 20:42:51.922759 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.922708    2554 scope.go:117] "RemoveContainer" containerID="f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"
Sep 15 20:42:51.931837 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.931819    2554 scope.go:117] "RemoveContainer" containerID="246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"
Sep 15 20:42:51.940157 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.940137    2554 scope.go:117] "RemoveContainer" containerID="f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"
Sep 15 20:42:51.940447 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:42:51.940428    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125\": container with ID starting with f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125 not found: ID does not exist" containerID="f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"
Sep 15 20:42:51.940520 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.940463    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125"} err="failed to get container status \"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125\": rpc error: code = NotFound desc = could not find container \"f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125\": container with ID starting with f67a6ea8ad8bebdce7f69377615012d645bfc0fbe6f19382fcb7120b51dc8125 not found: ID does not exist"
Sep 15 20:42:51.940520 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.940488    2554 scope.go:117] "RemoveContainer" containerID="246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"
Sep 15 20:42:51.940793 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:42:51.940774    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a\": container with ID starting with 246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a not found: ID does not exist" containerID="246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"
Sep 15 20:42:51.940833 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.940799    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a"} err="failed to get container status \"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a\": rpc error: code = NotFound desc = could not find container \"246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a\": container with ID starting with 246b56f64259c0b2118b33542dc94c2476ed78d77c6e60bf820d21ad62e0130a not found: ID does not exist"
Sep 15 20:42:51.944197 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.944175    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:42:51.946791 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:51.946770    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c005f8-openshift-default-847bc549c4-dt7rc"]
Sep 15 20:42:52.022889 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:42:52.022862    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" path="/var/lib/kubelet/pods/8f011a59-6bad-4d70-9d88-e90f4e0088fc/volumes"
Sep 15 20:43:00.235831 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:00.235793    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:43:03.616129 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:03.616091    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:43:03.616587 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:03.616353    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy" containerID="cri-o://df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d" gracePeriod=30
Sep 15 20:43:06.506578 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:06.506544    2554 scope.go:117] "RemoveContainer" containerID="e62aaf52d98eb703a8855abc4e293ff97d4924c2bc6fce23b245564897c03ed7"
Sep 15 20:43:08.866237 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.866210    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:43:08.959554 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959525    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjmq4\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.959748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959567    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.959748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959595    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.959748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959637    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.959748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959691    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.959748 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959736    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.960058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959768    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.960058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959815    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.960058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959843    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket\") pod \"6971fd7b-d459-4346-b546-a65e11b4264c\" (UID: \"6971fd7b-d459-4346-b546-a65e11b4264c\") "
Sep 15 20:43:08.960058 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.959950    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data" (OuterVolumeSpecName: "istio-data") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:43:08.960266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960068    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:43:08.960266 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960140    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:43:08.960364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960284    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:43:08.960364 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960321    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:43:08.960451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960392    2554 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-data\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:08.960451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960417    2554 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6971fd7b-d459-4346-b546-a65e11b4264c-istiod-ca-cert\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:08.960451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.960430    2554 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:08.961868 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.961836    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4" (OuterVolumeSpecName: "kube-api-access-gjmq4") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "kube-api-access-gjmq4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:43:08.962063 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.962040    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 20:43:08.962228 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.962200    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 20:43:08.962329 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:08.962221    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token" (OuterVolumeSpecName: "istio-token") pod "6971fd7b-d459-4346-b546-a65e11b4264c" (UID: "6971fd7b-d459-4346-b546-a65e11b4264c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:43:09.012993 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.012941    2554 generic.go:356] "Generic (PLEG): container finished" podID="6971fd7b-d459-4346-b546-a65e11b4264c" containerID="df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d" exitCode=0
Sep 15 20:43:09.013169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.013014    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"
Sep 15 20:43:09.013169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.013011    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerDied","Data":"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"}
Sep 15 20:43:09.013169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.013068    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h" event={"ID":"6971fd7b-d459-4346-b546-a65e11b4264c","Type":"ContainerDied","Data":"9f0af2920df4e39fd71d13179a1a8b648b4323737da048f50eae02af9472155e"}
Sep 15 20:43:09.013169 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.013090    2554 scope.go:117] "RemoveContainer" containerID="df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"
Sep 15 20:43:09.022740 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.022721    2554 scope.go:117] "RemoveContainer" containerID="09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"
Sep 15 20:43:09.030870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.030851    2554 scope.go:117] "RemoveContainer" containerID="df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"
Sep 15 20:43:09.031188 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:43:09.031162    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d\": container with ID starting with df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d not found: ID does not exist" containerID="df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"
Sep 15 20:43:09.031285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.031195    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d"} err="failed to get container status \"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d\": rpc error: code = NotFound desc = could not find container \"df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d\": container with ID starting with df89d711531638aa7bd267944c54fd6c1a9d0e7320b75c606ae4fde3d84a514d not found: ID does not exist"
Sep 15 20:43:09.031285 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.031218    2554 scope.go:117] "RemoveContainer" containerID="09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"
Sep 15 20:43:09.031506 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:43:09.031488    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1\": container with ID starting with 09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1 not found: ID does not exist" containerID="09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"
Sep 15 20:43:09.031561 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.031515    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1"} err="failed to get container status \"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1\": rpc error: code = NotFound desc = could not find container \"09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1\": container with ID starting with 09606244a8e51dbb70d57df28efd927d4d08a185baefaeca13a013e0c2230bc1 not found: ID does not exist"
Sep 15 20:43:09.038263 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.038234    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:43:09.042277 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.042252    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-8dc819-openshift-default-64cf6b5694-qzj7h"]
Sep 15 20:43:09.060913 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060879    2554 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-credential-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:09.060913 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060910    2554 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-workload-socket\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:09.060913 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060923    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjmq4\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-kube-api-access-gjmq4\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:09.061172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060932    2554 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6971fd7b-d459-4346-b546-a65e11b4264c-istio-podinfo\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:09.061172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060942    2554 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6971fd7b-d459-4346-b546-a65e11b4264c-istio-token\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:09.061172 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:09.060950    2554 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6971fd7b-d459-4346-b546-a65e11b4264c-istio-envoy\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:10.022385 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:10.022351    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" path="/var/lib/kubelet/pods/6971fd7b-d459-4346-b546-a65e11b4264c/volumes"
Sep 15 20:43:14.424601 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:14.424565    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"]
Sep 15 20:43:14.429870 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:14.429844    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-92702a-29825070-clk2g"]
Sep 15 20:43:16.023381 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:16.023350    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41ed2adf-1b66-4204-a88a-d918e2031436" path="/var/lib/kubelet/pods/41ed2adf-1b66-4204-a88a-d918e2031436/volumes"
Sep 15 20:43:17.329951 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:17.329908    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:43:31.914069 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.914032    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:43:31.914612 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.914311    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerName="payload-processing" containerID="cri-o://ff886b5e5568c2fd1322f6c5eb573313b90c8807cffefadac9a3da742b49ed0d" gracePeriod=30
Sep 15 20:43:31.919738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.919700    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:43:31.920004 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.919943    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerName="payload-pre-processing" containerID="cri-o://9f404f18037bb1f0c74361683246061ea8797a5171a2c72d3557ef3c98c9ee18" gracePeriod=30
Sep 15 20:43:31.939766 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.939724    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.65:9004: connect: connection refused"
Sep 15 20:43:31.939929 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:31.939766    2554 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.64:9004: connect: connection refused"
Sep 15 20:43:32.115879 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.115841    2554 generic.go:356] "Generic (PLEG): container finished" podID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerID="9f404f18037bb1f0c74361683246061ea8797a5171a2c72d3557ef3c98c9ee18" exitCode=0
Sep 15 20:43:32.116008 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.115901    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" event={"ID":"82de4092-c0d1-46a8-a6c3-92e71c4a7b30","Type":"ContainerDied","Data":"9f404f18037bb1f0c74361683246061ea8797a5171a2c72d3557ef3c98c9ee18"}
Sep 15 20:43:32.118031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.117974    2554 generic.go:356] "Generic (PLEG): container finished" podID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerID="ff886b5e5568c2fd1322f6c5eb573313b90c8807cffefadac9a3da742b49ed0d" exitCode=0
Sep 15 20:43:32.118031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.118017    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" event={"ID":"f26d6cd5-0f53-4b9f-a32a-dd854df0a522","Type":"ContainerDied","Data":"ff886b5e5568c2fd1322f6c5eb573313b90c8807cffefadac9a3da742b49ed0d"}
Sep 15 20:43:32.191949 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.191925    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:43:32.194449 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.194427    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:43:32.258866 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.258833    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume\") pod \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") "
Sep 15 20:43:32.259116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.258890    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rbgn\" (UniqueName: \"kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn\") pod \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\" (UID: \"f26d6cd5-0f53-4b9f-a32a-dd854df0a522\") "
Sep 15 20:43:32.259116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.258965    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-thn4b\" (UniqueName: \"kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b\") pod \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") "
Sep 15 20:43:32.259116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.259051    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume\") pod \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\" (UID: \"82de4092-c0d1-46a8-a6c3-92e71c4a7b30\") "
Sep 15 20:43:32.259328 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.259306    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f26d6cd5-0f53-4b9f-a32a-dd854df0a522" (UID: "f26d6cd5-0f53-4b9f-a32a-dd854df0a522"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:43:32.259553 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.259524    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "82de4092-c0d1-46a8-a6c3-92e71c4a7b30" (UID: "82de4092-c0d1-46a8-a6c3-92e71c4a7b30"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:43:32.261117 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.261095    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b" (OuterVolumeSpecName: "kube-api-access-thn4b") pod "82de4092-c0d1-46a8-a6c3-92e71c4a7b30" (UID: "82de4092-c0d1-46a8-a6c3-92e71c4a7b30"). InnerVolumeSpecName "kube-api-access-thn4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:43:32.261206 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.261163    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn" (OuterVolumeSpecName: "kube-api-access-7rbgn") pod "f26d6cd5-0f53-4b9f-a32a-dd854df0a522" (UID: "f26d6cd5-0f53-4b9f-a32a-dd854df0a522"). InnerVolumeSpecName "kube-api-access-7rbgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:43:32.359919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.359882    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:32.359919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.359911    2554 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-plugins-config-volume\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:32.359919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.359921    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rbgn\" (UniqueName: \"kubernetes.io/projected/f26d6cd5-0f53-4b9f-a32a-dd854df0a522-kube-api-access-7rbgn\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:32.359919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:32.359930    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-thn4b\" (UniqueName: \"kubernetes.io/projected/82de4092-c0d1-46a8-a6c3-92e71c4a7b30-kube-api-access-thn4b\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:43:33.123971 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.123942    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"
Sep 15 20:43:33.124451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.123997    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn" event={"ID":"82de4092-c0d1-46a8-a6c3-92e71c4a7b30","Type":"ContainerDied","Data":"7044ee724930f4ee1c7f09dae8080afdd5c83eb200a3b1ce58ae3aa7a8acfc52"}
Sep 15 20:43:33.124451 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.124058    2554 scope.go:117] "RemoveContainer" containerID="9f404f18037bb1f0c74361683246061ea8797a5171a2c72d3557ef3c98c9ee18"
Sep 15 20:43:33.125421 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.125389    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp" event={"ID":"f26d6cd5-0f53-4b9f-a32a-dd854df0a522","Type":"ContainerDied","Data":"180f8effc7f5f7afa4c47754eb55b06d70c42a4cdb1ee34f7d0cf33fe77144d2"}
Sep 15 20:43:33.125486 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.125431    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"
Sep 15 20:43:33.132919 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.132896    2554 scope.go:117] "RemoveContainer" containerID="ff886b5e5568c2fd1322f6c5eb573313b90c8807cffefadac9a3da742b49ed0d"
Sep 15 20:43:33.149726 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.149695    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:43:33.155386 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.155360    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-e80b38-55d7c5f56f-gddxp"]
Sep 15 20:43:33.165534 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.165498    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:43:33.169504 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:33.169481    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-e80b38-59ccb6c4fd-2s2pn"]
Sep 15 20:43:34.023495 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:34.023461    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" path="/var/lib/kubelet/pods/82de4092-c0d1-46a8-a6c3-92e71c4a7b30/volumes"
Sep 15 20:43:34.023828 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:34.023816    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" path="/var/lib/kubelet/pods/f26d6cd5-0f53-4b9f-a32a-dd854df0a522/volumes"
Sep 15 20:43:35.032280 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:35.032242    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:43:43.323031 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:43:43.322993    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:44:06.526906 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:44:06.526825    2554 scope.go:117] "RemoveContainer" containerID="12d6b939078401e0863776c1491590e52ab35180a301638153da87a93b53d52d"
Sep 15 20:45:05.020357 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:45:05.020324    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:45:30.929654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:45:30.929568    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:45:39.628334 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:45:39.628290    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:45:47.529016 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:45:47.528962    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:46:02.334346 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:46:02.334302    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:46:10.526152 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:46:10.526109    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:47:40.023049 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:47:40.023016    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:47:46.631714 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:47:46.631682    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:47:56.326743 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:47:56.326703    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:48:07.727997 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:48:07.727954    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:48:22.927011 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:48:22.926964    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:48:54.336267 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:48:54.336225    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:03.327899 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:03.327858    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:10.425054 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:10.425010    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:16.533226 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.533187    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:16.937230 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937142    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:16.937433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937419    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.937433 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937432    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937444    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937450    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937456    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937462    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937473    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937478    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937486    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerName="payload-pre-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937491    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerName="payload-pre-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937501    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937507    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937521    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05775494-6329-4c4b-948e-aa15bd307665" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937526    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="05775494-6329-4c4b-948e-aa15bd307665" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937534    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937539    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937544    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937549    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" containerName="payload-processing"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937592    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:49:16.937586 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937598    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937604    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="6971fd7b-d459-4346-b546-a65e11b4264c" containerName="istio-proxy"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937609    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="82de4092-c0d1-46a8-a6c3-92e71c4a7b30" containerName="payload-pre-processing"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937615    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b677a11-7eb3-48ce-9dc9-f828f89636e7" containerName="payload-processing"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937622    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="f26d6cd5-0f53-4b9f-a32a-dd854df0a522" containerName="payload-processing"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937629    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937635    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="05775494-6329-4c4b-948e-aa15bd307665" containerName="payload-processing"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937639    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:49:16.938583 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.937646    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f011a59-6bad-4d70-9d88-e90f4e0088fc" containerName="istio-proxy"
Sep 15 20:49:16.940645 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.940620    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:16.944468 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.944441    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 20:49:16.944672 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.944459    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 20:49:16.944794 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.944464    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 20:49:16.944876 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.944518    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-76rfp\""
Sep 15 20:49:16.944960 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.944520    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 20:49:16.952003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:16.951958    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:17.022533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.022494    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.022533 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.022548    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kns2n\" (UniqueName: \"kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.022762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.022608    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.022762 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.022640    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.123577 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.123537    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.123789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.123611    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kns2n\" (UniqueName: \"kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.123789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.123673    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.123789 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.123717    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.124573 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.124544    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.126223 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.126202    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.126342 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.126326    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.131023 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.130968    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kns2n\" (UniqueName: \"kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n\") pod \"maas-api-7d5d7c6468-8gppq\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") " pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.255196 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.255155    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:17.525020 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.524976    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:17.527155 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:49:17.527125    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a8bc48_49d4_4c3e_9248_4dc6f3f49e32.slice/crio-d5f25a176cc887f04b50319e0ffddad4696be9f73402177c10b41a05d4a10659 WatchSource:0}: Error finding container d5f25a176cc887f04b50319e0ffddad4696be9f73402177c10b41a05d4a10659: Status 404 returned error can't find the container with id d5f25a176cc887f04b50319e0ffddad4696be9f73402177c10b41a05d4a10659
Sep 15 20:49:17.528657 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.528637    2554 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 20:49:17.601183 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:17.601148    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" event={"ID":"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32","Type":"ContainerStarted","Data":"d5f25a176cc887f04b50319e0ffddad4696be9f73402177c10b41a05d4a10659"}
Sep 15 20:49:20.618293 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:20.618253    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" event={"ID":"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32","Type":"ContainerStarted","Data":"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"}
Sep 15 20:49:20.618714 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:20.618355    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:20.635941 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:20.635891    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" podStartSLOduration=2.279611121 podStartE2EDuration="4.635876226s" totalImagesPullingTime="2.356265105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 20:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:49:20.634621271 +0000 UTC m=+2655.079580280" watchObservedRunningTime="2026-09-15 20:49:20.635876226 +0000 UTC m=+2655.080835233"
Sep 15 20:49:24.321003 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.320947    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:24.613226 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.613136    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:24.613378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.613318    2554 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" podUID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" containerName="maas-api" containerID="cri-o://9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b" gracePeriod=30
Sep 15 20:49:24.619462 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.619436    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:24.869723 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.869633    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:24.998097 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.998062    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca\") pod \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") "
Sep 15 20:49:24.998320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.998160    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls\") pod \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") "
Sep 15 20:49:24.998320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.998197    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs\") pod \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") "
Sep 15 20:49:24.998320 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.998237    2554 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kns2n\" (UniqueName: \"kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n\") pod \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\" (UID: \"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32\") "
Sep 15 20:49:24.998518 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:24.998483    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" (UID: "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 20:49:25.000579 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.000537    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" (UID: "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:49:25.000721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.000578    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n" (OuterVolumeSpecName: "kube-api-access-kns2n") pod "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" (UID: "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32"). InnerVolumeSpecName "kube-api-access-kns2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 20:49:25.000721 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.000675    2554 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" (UID: "37a8bc48-49d4-4c3e-9248-4dc6f3f49e32"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 20:49:25.099512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.099477    2554 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-maas-api-tls\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:49:25.099512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.099509    2554 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-metrics-certs\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:49:25.099512 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.099519    2554 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kns2n\" (UniqueName: \"kubernetes.io/projected/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-kube-api-access-kns2n\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:49:25.099768 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.099528    2554 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32-openshift-service-ca\") on node \"ip-10-0-137-138.ec2.internal\" DevicePath \"\""
Sep 15 20:49:25.640953 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.640910    2554 generic.go:356] "Generic (PLEG): container finished" podID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" containerID="9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b" exitCode=0
Sep 15 20:49:25.641370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.640959    2554 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"
Sep 15 20:49:25.641370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.641014    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" event={"ID":"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32","Type":"ContainerDied","Data":"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"}
Sep 15 20:49:25.641370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.641106    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq" event={"ID":"37a8bc48-49d4-4c3e-9248-4dc6f3f49e32","Type":"ContainerDied","Data":"d5f25a176cc887f04b50319e0ffddad4696be9f73402177c10b41a05d4a10659"}
Sep 15 20:49:25.641370 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.641137    2554 scope.go:117] "RemoveContainer" containerID="9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"
Sep 15 20:49:25.649930 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.649909    2554 scope.go:117] "RemoveContainer" containerID="9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"
Sep 15 20:49:25.650270 ip-10-0-137-138 kubenswrapper[2554]: E0915 20:49:25.650248    2554 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b\": container with ID starting with 9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b not found: ID does not exist" containerID="9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"
Sep 15 20:49:25.650327 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.650281    2554 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b"} err="failed to get container status \"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b\": rpc error: code = NotFound desc = could not find container \"9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b\": container with ID starting with 9cf36b1e9a0ec5ec9c42761466d5349755a64a9a727320a1145369897b2a341b not found: ID does not exist"
Sep 15 20:49:25.662569 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.662541    2554 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:25.665587 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:25.665560    2554 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5d7c6468-8gppq"]
Sep 15 20:49:26.022896 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:26.022848    2554 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" path="/var/lib/kubelet/pods/37a8bc48-49d4-4c3e-9248-4dc6f3f49e32/volumes"
Sep 15 20:49:31.032060 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:31.032027    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:37.428964 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:37.428926    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:43.430272 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:43.430233    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-5nrrx"]
Sep 15 20:49:52.492384 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:52.492357    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75fcf566-6j8wd_b4d0b552-e96c-45b9-a4cc-362bf8f671b9/copy-manifests/0.log"
Sep 15 20:49:52.505783 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:52.505751    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75fcf566-6j8wd_b4d0b552-e96c-45b9-a4cc-362bf8f671b9/manager/0.log"
Sep 15 20:49:53.275053 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:53.275025    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29825070-kfxrt_8889975c-870d-4fb8-addd-e44621e30bc0/cleanup/0.log"
Sep 15 20:49:54.842335 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:54.842302    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nrrx_2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e/limitador/0.log"
Sep 15 20:49:55.421120 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:55.421088    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vbprg_8bb0cf94-2ec7-449d-bbc3-8456435634f5/discovery/0.log"
Sep 15 20:49:55.749617 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:55.749582    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/1.log"
Sep 15 20:49:56.648303 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:56.648274    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-nwrf6_212d4d5d-27c0-40f4-9b60-50269d4529a0/main/0.log"
Sep 15 20:49:56.871730 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:49:56.871700    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fsm9nr_868370d6-1807-4f43-9925-e33fedb0fded/main/0.log"
Sep 15 20:50:05.705425 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:05.705349    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-x9gbq_cdac05d3-89c4-4cac-a628-d8c27abd491d/global-pull-secret-syncer/0.log"
Sep 15 20:50:05.783581 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:05.783541    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5rbh9_167c36a0-cf9e-454c-a6c8-cdfc31feda2c/konnectivity-agent/0.log"
Sep 15 20:50:05.863515 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:05.863490    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-138.ec2.internal_d5fe63d2e1dec62eab5d7d2258fa34d2/haproxy/0.log"
Sep 15 20:50:10.468312 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:10.468282    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-5nrrx_2c6f6d02-e8f3-45b1-bd33-1f0662b9b78e/limitador/0.log"
Sep 15 20:50:12.470680 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:12.470649    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5d85778b9d-mm7pg_d7043486-0da4-4266-9b59-18e51d04b308/monitoring-plugin/0.log"
Sep 15 20:50:12.568682 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:12.568653    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gkd5g_aca756c2-ee6f-4ea3-806a-cd3b172386db/node-exporter/0.log"
Sep 15 20:50:12.588642 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:12.588611    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gkd5g_aca756c2-ee6f-4ea3-806a-cd3b172386db/kube-rbac-proxy/0.log"
Sep 15 20:50:12.610037 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:12.610011    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-gkd5g_aca756c2-ee6f-4ea3-806a-cd3b172386db/init-textfile/0.log"
Sep 15 20:50:13.024644 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:13.024611    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76d96dfb5b-gr9g7_2df63b32-f27b-4f49-be48-fde18a818ba2/telemeter-client/0.log"
Sep 15 20:50:13.050094 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:13.050068    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76d96dfb5b-gr9g7_2df63b32-f27b-4f49-be48-fde18a818ba2/reload/0.log"
Sep 15 20:50:13.075427 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:13.075400    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-76d96dfb5b-gr9g7_2df63b32-f27b-4f49-be48-fde18a818ba2/kube-rbac-proxy/0.log"
Sep 15 20:50:16.086472 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.086435    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-sm6c2_7e750dc6-f7cb-4be1-b7b9-95c7943c575c/download-server/0.log"
Sep 15 20:50:16.202245 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202204    2554 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"]
Sep 15 20:50:16.202546 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202533    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:50:16.202596 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202549    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b9c99f9-77b5-44dd-b7b8-2d3fe5bb57e8" containerName="istio-proxy"
Sep 15 20:50:16.202596 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202561    2554 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" containerName="maas-api"
Sep 15 20:50:16.202596 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202566    2554 state_mem.go:107] "Deleted CPUSet assignment" podUID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" containerName="maas-api"
Sep 15 20:50:16.202706 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.202615    2554 memory_manager.go:368] "RemoveStaleState removing state" podUID="37a8bc48-49d4-4c3e-9248-4dc6f3f49e32" containerName="maas-api"
Sep 15 20:50:16.205445 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.205416    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.207715 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.207691    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bqd6\"/\"kube-root-ca.crt\""
Sep 15 20:50:16.208589 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.208569    2554 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8bqd6\"/\"default-dockercfg-fgwsj\""
Sep 15 20:50:16.208589 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.208585    2554 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8bqd6\"/\"openshift-service-ca.crt\""
Sep 15 20:50:16.215926 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.215898    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"]
Sep 15 20:50:16.242423 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.242388    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-lib-modules\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.242423 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.242428    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-proc\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.242654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.242448    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ff52\" (UniqueName: \"kubernetes.io/projected/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-kube-api-access-2ff52\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.242654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.242568    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-sys\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.242654 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.242613    2554 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-podres\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.343964    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-lib-modules\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344043    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-proc\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344082 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344069    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ff52\" (UniqueName: \"kubernetes.io/projected/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-kube-api-access-2ff52\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344123    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-sys\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344171    2554 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-podres\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344179    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-lib-modules\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344182    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-proc\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344219    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-sys\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.344306 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.344300    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-podres\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.351891 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.351859    2554 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ff52\" (UniqueName: \"kubernetes.io/projected/89d18d76-7bf7-4c0c-bd54-82c754f84ce6-kube-api-access-2ff52\") pod \"perf-node-gather-daemonset-6xdqv\" (UID: \"89d18d76-7bf7-4c0c-bd54-82c754f84ce6\") " pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.516371 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.516334    2554 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.787388 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.787349    2554 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"]
Sep 15 20:50:16.790703 ip-10-0-137-138 kubenswrapper[2554]: W0915 20:50:16.790672    2554 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod89d18d76_7bf7_4c0c_bd54_82c754f84ce6.slice/crio-4559eb5737f529ed227d1659b8469f21ffc96c0bb37e0675e4f4814cc13c28fe WatchSource:0}: Error finding container 4559eb5737f529ed227d1659b8469f21ffc96c0bb37e0675e4f4814cc13c28fe: Status 404 returned error can't find the container with id 4559eb5737f529ed227d1659b8469f21ffc96c0bb37e0675e4f4814cc13c28fe
Sep 15 20:50:16.863291 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.863256    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv" event={"ID":"89d18d76-7bf7-4c0c-bd54-82c754f84ce6","Type":"ContainerStarted","Data":"00708ce0509b625cc0aa89be8c91fc686ae6f22ce465a5c53f0d284dafd78da3"}
Sep 15 20:50:16.863482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.863311    2554 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv" event={"ID":"89d18d76-7bf7-4c0c-bd54-82c754f84ce6","Type":"ContainerStarted","Data":"4559eb5737f529ed227d1659b8469f21ffc96c0bb37e0675e4f4814cc13c28fe"}
Sep 15 20:50:16.863482 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.863389    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:16.879609 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:16.879552    2554 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv" podStartSLOduration=0.879534229 podStartE2EDuration="879.534229ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 20:50:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 20:50:16.878151079 +0000 UTC m=+2711.323110100" watchObservedRunningTime="2026-09-15 20:50:16.879534229 +0000 UTC m=+2711.324493295"
Sep 15 20:50:17.990517 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:17.990486    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpnkz_a6cae6c4-78ed-4d09-a44f-e065014477e7/dns/0.log"
Sep 15 20:50:18.010562 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:18.010535    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gpnkz_a6cae6c4-78ed-4d09-a44f-e065014477e7/kube-rbac-proxy/0.log"
Sep 15 20:50:18.121504 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:18.121477    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qhcsp_6015d577-ccef-4b0e-b044-555b6f100667/dns-node-resolver/0.log"
Sep 15 20:50:18.810079 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:18.810048    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nx9gl_91a9d341-1103-4d6c-9672-f8454d43b179/node-ca/0.log"
Sep 15 20:50:20.243378 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:20.243336    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vbprg_8bb0cf94-2ec7-449d-bbc3-8456435634f5/discovery/0.log"
Sep 15 20:50:20.327104 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:20.327073    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/0.log"
Sep 15 20:50:20.329415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:20.329392    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/1.log"
Sep 15 20:50:21.393116 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:21.393088    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lxmzf_989a3f9f-1483-41c6-9523-eb28dca75372/serve-healthcheck-canary/0.log"
Sep 15 20:50:22.008535 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:22.008508    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm77n_9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0/kube-rbac-proxy/0.log"
Sep 15 20:50:22.028582 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:22.028557    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm77n_9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0/exporter/0.log"
Sep 15 20:50:22.049727 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:22.049700    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xm77n_9b7f7aaa-7fd0-4cdf-aedc-29de4606aed0/extractor/0.log"
Sep 15 20:50:22.877525 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:22.877496    2554 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8bqd6/perf-node-gather-daemonset-6xdqv"
Sep 15 20:50:24.717836 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:24.717800    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75fcf566-6j8wd_b4d0b552-e96c-45b9-a4cc-362bf8f671b9/manager/0.log"
Sep 15 20:50:24.736089 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:24.736064    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-75fcf566-6j8wd_b4d0b552-e96c-45b9-a4cc-362bf8f671b9/copy-manifests/0.log"
Sep 15 20:50:26.296001 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:26.295956    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-d95cdffcd-98bpr_677fd82d-0247-464b-bb8f-a749717367fb/manager/0.log"
Sep 15 20:50:27.798734 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:27.798691    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vbprg_8bb0cf94-2ec7-449d-bbc3-8456435634f5/discovery/0.log"
Sep 15 20:50:27.841486 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:27.841450    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/0.log"
Sep 15 20:50:27.844077 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:27.844057    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/1.log"
Sep 15 20:50:29.914209 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:29.914179    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-vbprg_8bb0cf94-2ec7-449d-bbc3-8456435634f5/discovery/0.log"
Sep 15 20:50:29.971415 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:29.971384    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/0.log"
Sep 15 20:50:29.973697 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:29.973676    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-7pcnw_2472ef40-b8de-4b50-bb63-1180f2faada5/istio-proxy/1.log"
Sep 15 20:50:32.997852 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:32.997816    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8chj2_7a4a7ecd-044b-4cee-88c8-f7dbcbba2438/kube-multus/0.log"
Sep 15 20:50:33.315170 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.315090    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/kube-multus-additional-cni-plugins/0.log"
Sep 15 20:50:33.335221 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.335195    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/egress-router-binary-copy/0.log"
Sep 15 20:50:33.370956 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.370926    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/cni-plugins/0.log"
Sep 15 20:50:33.405897 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.405868    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/bond-cni-plugin/0.log"
Sep 15 20:50:33.456462 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.456433    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/routeoverride-cni/0.log"
Sep 15 20:50:33.480086 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.480054    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/whereabouts-cni-bincopy/0.log"
Sep 15 20:50:33.499698 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.499668    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rr9rq_d786166b-73d1-4c66-815e-0ef11d6ba633/whereabouts-cni/0.log"
Sep 15 20:50:33.693738 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.693654    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b7xr_eae0f378-78d2-41d0-a359-668883a0cd11/network-metrics-daemon/0.log"
Sep 15 20:50:33.710547 ip-10-0-137-138 kubenswrapper[2554]: I0915 20:50:33.710515    2554 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-9b7xr_eae0f378-78d2-41d0-a359-668883a0cd11/kube-rbac-proxy/0.log"